DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Open models have reached frontier-level agent performance. Starting today, you can point LangChain Deep Agents at NVIDIA Nemotron 3 Ultra running on DeepInfra and get top-tier agent accuracy at roughly 10x lower cost than leading closed models.
Agent quality is no longer just about the model. It's about the harness — the prompts, tools, and middleware wrapped around the model loop. LangChain proved this by tuning their Deep Agents harness specifically for Nemotron 3 Ultra, with no model retraining. The result: top agent accuracy among open models on LangChain's Deep Agents evaluation suite, at approximately 10x lower cost per run than closed alternatives.
And you can run all of it on DeepInfra today.
An agent is a model plus a harness. The model generates; the harness is everything around the loop — the system prompt, the tool descriptions, the sandbox configuration, and the middleware that shapes behavior. LangChain's tuning process started by running Nemotron 3 Ultra against their public Deep Agents benchmark suite, then analyzing execution traces to find where the model underperformed.
From that analysis, LangChain published a Deep Agents model profile tuned specifically for Nemotron 3 Ultra, covering system prompts, tool descriptions, and sandbox configuration. No retraining. The gains came entirely from engineering the environment around the model.
"Top agent accuracy among open models at approximately 10x lower cost than closed alternatives."
For developers, this means the hard part is already done. The tuned harness ships with LangChain Deep Agents. You bring your agent code, point it at a hosted Nemotron 3 Ultra endpoint, and you're running frontier-level agents on open models.
LangChain does the harness. NVIDIA provides the open model. DeepInfra is where you run it in production.
Nemotron 3 Ultra is live on DeepInfra now, served through our OpenAI-compatible API. It delivers up to 5x faster inference and up to 30% lower cost for agentic workloads, with support for up to 1M token context. That means LangChain Deep Agents can point at your DeepInfra endpoint with a single configuration change. No new SDK, no custom integration.
Pricing is $0.50 per 1M input tokens and $2.20 per 1M output tokens, with cached input at $0.10. For latency-critical agent traffic, Nemotron 3 Ultra also supports DeepInfra's Priority Tier. And because the whole stack is open — open model, open harness, open runtime — you own it end to end. Customize it, improve it, and run it wherever you need to.
Here's the entire integration — LangChain Deep Agents pointed at Nemotron 3 Ultra on DeepInfra:
from deepagents import create_deep_agent
from langchain_openai import ChatOpenAI
def get_weather(city: str) -> str:
"""Get weather for a given city."""
return f"It's always sunny in {city}!"
model = ChatOpenAI(
model="nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B",
base_url="https://api.deepinfra.com/v1/openai",
api_key="$DEEPINFRA_TOKEN",
)
agent = create_deep_agent(
model=model,
tools=[get_weather],
system_prompt="You are a helpful assistant",
)
result = agent.invoke(
{"messages": [{"role": "user",
"content": "what is the weather in sf"}]}
)
for msg in result["messages"]:
msg.pretty_print()
That's it. The tuned harness comes from LangChain Deep Agents, the model runs on DeepInfra, and you have a frontier-level agent running on open models.
Nemotron 3 Ultra is available on DeepInfra now. Check out our developer cookbook for a complete, working example — from setup to a running Deep Agent — and start building.
Long Context models incomingMany users requested longer context models to help them summarize bigger chunks
of text or write novels with ease.
We're proud to announce our long context model selection that will grow bigger in the comming weeks.
Models
Mistral-based models have a context size of 32k, and amazon recently r...
Multi-Turn RL: A Guide to Getting Reinforcement Learning Right<p>The first multi-turn RL run you launch will spend most of its life doing something you would not call training. You watch GPU utilization sit under half, watch a step take eleven minutes, and go hunting for a bug in your gradient accumulation. There is no bug. The trainer is waiting on rollouts. This is […]</p>
How DeepInfra Built on NVIDIA's Inference Stack and Why It Paid OffWhen we built DeepInfra, we made a deliberate bet on the NVIDIA inference software stack. Not as a hedge — as a conviction. Today, that bet is paying off in ways that are easy to measure.© 2026 DeepInfra. All rights reserved.