We use essential cookies to make our site work. With your consent, we may also use non-essential cookies to improve user experience and analyze website traffic…

DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Frontier-Level Agents on Open Models: LangChain Deep Agents + NVIDIA Nemotron 3 Ultra, Live on DeepInfra
Published on 2026.07.08 by Aray Sultanbekova
Frontier-Level Agents on Open Models: LangChain Deep Agents + NVIDIA Nemotron 3 Ultra, Live on DeepInfra

Open models have reached frontier-level agent performance. Starting today, you can point LangChain Deep Agents at NVIDIA Nemotron 3 Ultra running on DeepInfra and get top-tier agent accuracy at roughly 10x lower cost than leading closed models.

Agent quality is no longer just about the model. It's about the harness — the prompts, tools, and middleware wrapped around the model loop. LangChain proved this by tuning their Deep Agents harness specifically for Nemotron 3 Ultra, with no model retraining. The result: top agent accuracy among open models on LangChain's Deep Agents evaluation suite, at approximately 10x lower cost per run than closed alternatives.

And you can run all of it on DeepInfra today.

Why the harness matters

An agent is a model plus a harness. The model generates; the harness is everything around the loop — the system prompt, the tool descriptions, the sandbox configuration, and the middleware that shapes behavior. LangChain's tuning process started by running Nemotron 3 Ultra against their public Deep Agents benchmark suite, then analyzing execution traces to find where the model underperformed.

From that analysis, LangChain published a Deep Agents model profile tuned specifically for Nemotron 3 Ultra, covering system prompts, tool descriptions, and sandbox configuration. No retraining. The gains came entirely from engineering the environment around the model.

"Top agent accuracy among open models at approximately 10x lower cost than closed alternatives."

For developers, this means the hard part is already done. The tuned harness ships with LangChain Deep Agents. You bring your agent code, point it at a hosted Nemotron 3 Ultra endpoint, and you're running frontier-level agents on open models.

Where DeepInfra fits

LangChain does the harness. NVIDIA provides the open model. DeepInfra is where you run it in production.

Nemotron 3 Ultra is live on DeepInfra now, served through our OpenAI-compatible API. It delivers up to 5x faster inference and up to 30% lower cost for agentic workloads, with support for up to 1M token context. That means LangChain Deep Agents can point at your DeepInfra endpoint with a single configuration change. No new SDK, no custom integration.

Pricing is $0.50 per 1M input tokens and $2.20 per 1M output tokens, with cached input at $0.10. For latency-critical agent traffic, Nemotron 3 Ultra also supports DeepInfra's Priority Tier. And because the whole stack is open — open model, open harness, open runtime — you own it end to end. Customize it, improve it, and run it wherever you need to.

Get started in minutes

Here's the entire integration — LangChain Deep Agents pointed at Nemotron 3 Ultra on DeepInfra:

from deepagents import create_deep_agent
from langchain_openai import ChatOpenAI

def get_weather(city: str) -> str:
    """Get weather for a given city."""
    return f"It's always sunny in {city}!"

model = ChatOpenAI(
    model="nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B",
    base_url="https://api.deepinfra.com/v1/openai",
    api_key="$DEEPINFRA_TOKEN",
)

agent = create_deep_agent(
    model=model,
    tools=[get_weather],
    system_prompt="You are a helpful assistant",
)

result = agent.invoke(
    {"messages": [{"role": "user",
     "content": "what is the weather in sf"}]}
)
for msg in result["messages"]:
    msg.pretty_print()
copy

That's it. The tuned harness comes from LangChain Deep Agents, the model runs on DeepInfra, and you have a frontier-level agent running on open models.

Try it today

Nemotron 3 Ultra is available on DeepInfra now. Check out our developer cookbook for a complete, working example — from setup to a running Deep Agent — and start building.

Related articles
Qwen3.5 2B via DeepInfra: Latency, Throughput & CostQwen3.5 2B via DeepInfra: Latency, Throughput & Cost<p>About Qwen3.5 2B (Reasoning) Qwen3.5 2B is a compact 2-billion parameter open-weights model released in March 2026 as part of Alibaba Cloud&#8217;s Qwen3.5 Small Model Series. It employs an Efficient Hybrid Architecture combining Gated Delta Networks (a form of linear attention) with sparse Mixture-of-Experts, delivering high-throughput inference with minimal latency overhead — a significant architectural [&hellip;]</p>
Model Distillation Making AI Models EfficientModel Distillation Making AI Models EfficientAI Model Distillation Definition & Methodology Model distillation is the art of teaching a smaller, simpler model to perform as well as a larger one. It's like training an apprentice to take over a master's work—streamlining operations with comparable performance . If you're struggling with depl...
FLUX.1-dev Guide: Mastering Text-to-Image AI Prompts for Stunning and Consistent VisualsFLUX.1-dev Guide: Mastering Text-to-Image AI Prompts for Stunning and Consistent VisualsLearn how to craft compelling prompts for FLUX.1-dev to create stunning images.