DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

At DeepInfra we host the best open source LLM models. We are always working hard to make our APIs simple and easy to use.
Today we are excited to announce a very easy way to quickly try our models like Llama2 70b and Mistral 7b and compare them to OpenAI's models. You only need to change the API endpoint URL and the model name to quickly see if these models are a good fit for your application.
Here is a quick example of how to use the OpenAI Python client with our models:
import openai
# Point OpenAI client to our endpoint
openai.api_base = "https://api.deepinfra.com/v1/openai"
# Just leave the API key empty. You don't need it to try our models.
openai.api_key = ""
# Your chosen model here
MODEL_DI = "meta-llama/Llama-2-70b-chat-hf"
chat_completion = openai.ChatCompletion.create(
model="meta-llama/Llama-2-70b-chat-hf",
messages=[{"role": "user", "content": "Hello world"}],
stream=True,
)
# print the chat completion
for event in chat_completion:
print(event.choices)
To make it as simple as possible you don't even have to create an account with DeepInfra to
try our models. Just pass empty string as api_key and you are good to go. We rate limit the
unauthenticated requests by IP address.
When you are ready to use our models in production, you can create an account at DeepInfra and get an API key. We offer the best pricing for the llama 2 70b model at just $1 per 1M tokens. If you need any help, just reach out to us on our Discord server.
Wan 3.0: Model Documentation & Integration Guide<p>Wan3.0 is an all-in-one video generation model from Wan-AI, hosted on DeepInfra. It covers reference-based generation, editing, replication, and driving in a single model, and it accepts images, video clips, audio, documents, and web links as input. Use it for cinematic storytelling, social media content, and video editing. Every generation includes synchronized audio by default, […]</p>
AI Spend Audit: How to Reduce Costs With Open Models<p>In 2026, mentions of open-weight or open-source models on US earnings calls and at investor conferences ran about six times higher compared to the last year. The companies doing the talking are no longer only tech firms. PNC, CH Robinson and Siemens have all discussed open-weight models in recent weeks. The clearest example is Tinder. […]</p>
Muse Glimmer 30B: Model Overview, Benchmarks & API Guide<p>Muse Glimmer is a 30-billion-parameter open-weight model from Meta Superintelligence Labs, released on August 10, 2026 under Apache 2.0 and built for agent workloads: tool calling, multi-step tasks, coding agents and LLM-as-a-judge evaluation. It takes text and images as input, returns text, and has a 131,072-token context window. Meta distilled it from Muse Spark, its […]</p>
© 2026 DeepInfra. All rights reserved.