DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

At DeepInfra we host the best open source LLM models. We are always working hard to make our APIs simple and easy to use.
Today we are excited to announce a very easy way to quickly try our models like Llama2 70b and Mistral 7b and compare them to OpenAI's models. You only need to change the API endpoint URL and the model name to quickly see if these models are a good fit for your application.
Here is a quick example of how to use the OpenAI Python client with our models:
import openai
# Point OpenAI client to our endpoint
openai.api_base = "https://api.deepinfra.com/v1/openai"
# Just leave the API key empty. You don't need it to try our models.
openai.api_key = ""
# Your chosen model here
MODEL_DI = "meta-llama/Llama-2-70b-chat-hf"
chat_completion = openai.ChatCompletion.create(
model="meta-llama/Llama-2-70b-chat-hf",
messages=[{"role": "user", "content": "Hello world"}],
stream=True,
)
# print the chat completion
for event in chat_completion:
print(event.choices)
To make it as simple as possible you don't even have to create an account with DeepInfra to
try our models. Just pass empty string as api_key and you are good to go. We rate limit the
unauthenticated requests by IP address.
When you are ready to use our models in production, you can create an account at DeepInfra and get an API key. We offer the best pricing for the llama 2 70b model at just $1 per 1M tokens. If you need any help, just reach out to us on our Discord server.
Build an OCR-Powered PDF Reader & Summarizer with DeepInfra (Kimi K2)<p>This guide walks you from zero to working: you’ll learn what OCR is (and why PDFs can be tricky), how to turn any PDF—including those with screenshots of tables—into text, and how to let an LLM do the heavy lifting to clean OCR noise, reconstruct tables, and summarize the document. We’ll use DeepInfra’s OpenAI-compatible API […]</p>
Why Your API Bill Doubled Without Changing Models<p>You deployed a reasoning model, ran it for a week, and got a billing email that was twice what you expected. You didn’t change the model. You didn’t change the prompt. You didn’t add more users. The only thing that changed is that the model started thinking harder and that thinking costs money you can’t […]</p>
MiMo-V2.6-Pro Guide: Performance, Pricing & Providers<p>Updated November 2026. API Review Summary (October 2026) Attribute Value Developer Xiaomi Release Date September 21, 2026 Model Type Reasoning model (open weights) Artificial Analysis Intelligence Index 30 — ranks #5 of 29 comparable open-weights models on Artificial Analysis, where the median is 23 Speed 55 output tokens/sec Context Window 1M tokens (~1,500 A4 pages) […]</p>
© 2026 DeepInfra. All rights reserved.