We use essential cookies to make our site work. With your consent, we may also use non-essential cookies to improve user experience and analyze website traffic…

DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Frontier-Level Agents on Open Models: LangChain Deep Agents + NVIDIA Nemotron 3 Ultra, Live on DeepInfra
Published on 2026.07.08 by Aray Sultanbekova
Frontier-Level Agents on Open Models: LangChain Deep Agents + NVIDIA Nemotron 3 Ultra, Live on DeepInfra

Open models have reached frontier-level agent performance. Starting today, you can point LangChain Deep Agents at NVIDIA Nemotron 3 Ultra running on DeepInfra and get top-tier agent accuracy at roughly 10x lower cost than leading closed models.

Agent quality is no longer just about the model. It's about the harness — the prompts, tools, and middleware wrapped around the model loop. LangChain proved this by tuning their Deep Agents harness specifically for Nemotron 3 Ultra, with no model retraining. The result: top agent accuracy among open models on LangChain's Deep Agents evaluation suite, at approximately 10x lower cost per run than closed alternatives.

And you can run all of it on DeepInfra today.

Why the harness matters

An agent is a model plus a harness. The model generates; the harness is everything around the loop — the system prompt, the tool descriptions, the sandbox configuration, and the middleware that shapes behavior. LangChain's tuning process started by running Nemotron 3 Ultra against their public Deep Agents benchmark suite, then analyzing execution traces to find where the model underperformed.

From that analysis, LangChain published a Deep Agents model profile tuned specifically for Nemotron 3 Ultra, covering system prompts, tool descriptions, and sandbox configuration. No retraining. The gains came entirely from engineering the environment around the model.

"Top agent accuracy among open models at approximately 10x lower cost than closed alternatives."

For developers, this means the hard part is already done. The tuned harness ships with LangChain Deep Agents. You bring your agent code, point it at a hosted Nemotron 3 Ultra endpoint, and you're running frontier-level agents on open models.

Where DeepInfra fits

LangChain does the harness. NVIDIA provides the open model. DeepInfra is where you run it in production.

Nemotron 3 Ultra is live on DeepInfra now, served through our OpenAI-compatible API. It delivers up to 5x faster inference and up to 30% lower cost for agentic workloads, with support for up to 1M token context. That means LangChain Deep Agents can point at your DeepInfra endpoint with a single configuration change. No new SDK, no custom integration.

Pricing is $0.50 per 1M input tokens and $2.20 per 1M output tokens, with cached input at $0.10. For latency-critical agent traffic, Nemotron 3 Ultra also supports DeepInfra's Priority Tier. And because the whole stack is open — open model, open harness, open runtime — you own it end to end. Customize it, improve it, and run it wherever you need to.

Get started in minutes

Here's the entire integration — LangChain Deep Agents pointed at Nemotron 3 Ultra on DeepInfra:

from deepagents import create_deep_agent
from langchain_openai import ChatOpenAI

def get_weather(city: str) -> str:
    """Get weather for a given city."""
    return f"It's always sunny in {city}!"

model = ChatOpenAI(
    model="nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B",
    base_url="https://api.deepinfra.com/v1/openai",
    api_key="$DEEPINFRA_TOKEN",
)

agent = create_deep_agent(
    model=model,
    tools=[get_weather],
    system_prompt="You are a helpful assistant",
)

result = agent.invoke(
    {"messages": [{"role": "user",
     "content": "what is the weather in sf"}]}
)
for msg in result["messages"]:
    msg.pretty_print()
copy

That's it. The tuned harness comes from LangChain Deep Agents, the model runs on DeepInfra, and you have a frontier-level agent running on open models.

Try it today

Nemotron 3 Ultra is available on DeepInfra now. Check out our developer cookbook for a complete, working example — from setup to a running Deep Agent — and start building.

Related articles
Best SaaS Tools and API Providers for MiMo-V2.5Best SaaS Tools and API Providers for MiMo-V2.5<p>As LLM architectures grow increasingly complex, the introduction of the MiMo-V2.5 series represents a significant step forward in multimodal capabilities and massive context handling. Integrating a model with a 1M-token context window and native multimodal support (image, video, audio, text) introduces substantial infrastructure considerations. For developers and enterprise architects, the priorities are clear: managing inference [&hellip;]</p>
GLM-5.1 on DeepInfra: Z.AI’s Agentic Engineering ModelGLM-5.1 on DeepInfra: Z.AI’s Agentic Engineering Model<p>Z.AI&#8217;s GLM-5.1 scores 58.4 on SWE-Bench Pro — ahead of both Claude Opus 4.6 (57.3) and GPT-5.4 (57.7) on real-world software engineering tasks. It&#8217;s the direct successor to GLM-5, designed for agentic engineering: long-horizon coding tasks, terminal operations, and repository-level work. The core design premise is that previous models, including GLM-5, tend to plateau after [&hellip;]</p>
Build a RAG App With DeepInfra and LangChainBuild a RAG App With DeepInfra and LangChain<p>Ask a base language model about your company&#8217;s refund policy and it will answer with confidence, fluency, and no idea what your policy actually says. The facts live in your PDFs, your internal wiki, and your ticket history, none of which the model has ever seen during training. Retrieval-augmented generation closes that gap by fetching [&hellip;]</p>