The Trillion-Parameter Dilemma: MiMo-V2.5-Pro went open-source (1.02T params). Is self-hosting worth it when the API costs $70 for 387M tokens?

Key Takeaways

• Xiaomi open-sourced MiMo-V2.5-Pro, a model with 1.02 trillion parameters.
• The cost of running this model via the API is $70 for 387 million tokens.
• For a few hours of coding sessions per day, using the API remains cheaper than self-hosting on current hardware.
• Data privacy and fine-tuning on proprietary codebases are potential advantages of self-hosting.
• The model’s large size makes it difficult to run locally without substantial investment in hardware.

Has anyone attempted running open-source MiMo-V2.5-Pro? What kind of hardware is needed?

Stay ahead of AI. Get the most important stories delivered to your inbox — no spam, no noise.

Please enable JavaScript in your browser to complete this form.

Name *

First

Last

Email Name

Email *

Submit