DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

While everyone knows Llama 3 and Qwen, a quieter revolution has been happening in NVIDIA’s labs. They have been taking standard Llama models and “supercharging” them using advanced alignment techniques and pruning methods.
The result is Nemotron—a family of models that frequently tops the “Helpfulness” leaderboards (like Arena Hard), often beating GPT-4o while being significantly more efficient to run.
NVIDIA’s strategy is unique: they don’t just train models; they optimize them for hardware. This means you get models like the Nemotron-Super-49B, which delivers 70B-level intelligence at a fraction of the cost and memory footprint.
This guide breaks down the pricing for the Nemotron family on DeepInfra and helps you decide which one fits your budget.
If you are new to LLM APIs, the pricing can look confusing. You aren’t paid by the request or by the minute; you are charged by the “Token”.
Here is the simple breakdown of how to calculate your costs:
DeepInfra offers the full range of NVIDIA’s Nemotron models. Because these models are optimized for NVIDIA hardware (which DeepInfra runs on), the pricing is often very aggressive, especially for the “Super” and “Nano” variants.
You can view the full list and test them here: DeepInfra Nemotron Models.
| Model Name | Context Window | Input Price (per 1M) | Output Price (per 1M) |
| Llama-3.3-Nemotron-Super-49B-v1.5 | 128K | $0.10 | $0.40 |
| Llama-3.1-Nemotron-70B-Instruct | 128K | $1.20 | $1.20 |
| NVIDIA-Nemotron-Nano-12B-v2-VL | 128K | $0.20 | $0.60 |
| NVIDIA-Nemotron-Nano-9B-v2 | 128K | $0.04 | $0.16 |
Note: Prices are per 1 million tokens. A 128K context window allows these models to process entire books or long codebases in a single prompt.
The most interesting model on this list is undoubtedly the Llama-3.3-Nemotron-Super-49B.
Typically, to get “70B level” performance, you have to pay for a 70B parameter model. NVIDIA used a technique called Neural Architecture Search (NAS) to take the Llama 3.3 70B model and intelligently prune (remove) the parts of the brain that weren’t contributing much to intelligence.
If you are building a RAG application or a chatbot, the Super-49B is likely the “sweet spot” for 2025.
You might notice the Llama-3.1-Nemotron-70B-Instruct is significantly more expensive at $1.20/$1.20. Why?
This model wasn’t pruned for speed; it was optimized for quality. NVIDIA trained this using a special “HelpSteer2” dataset and advanced Reinforcement Learning from Human Feedback (RLHF).
While the base Llama 3.1 is smart, the Nemotron version is “better behaved.” It is less likely to refuse requests, gives more structured answers, and scores higher on “human preference” benchmarks. You pay a premium for this polish. It is best used for client-facing outputs where tone and strict instruction following are critical.
Let’s see how much you would actually save by choosing the right Nemotron model.
Estimated Cost:
(If you used the standard Nemotron 70B for this, the bill would be roughly $66.00. The “Super” model saves you nearly 90%.)
Estimated Cost:
At $0.20 per million input tokens, this is one of the most affordable Vision-Language models on the market. Competitors like GPT-4o charge upwards of $2.50 for similar multimodal inputs.
The Nemotron family offers a unique value proposition: NVIDIA-grade optimization on top of Meta’s open weights.
By selecting the specific Nemotron variant optimized for your workload, you can achieve better-than-GPT-4o results while keeping your infrastructure costs incredibly low.
Agents Need a Runtime Boundary, Not Just GuardrailsAs agents move beyond model calls to tools, APIs, and execution environments, the runtime becomes part of the architecture. How DeepInfra Sandboxes and Hosted Agents keep the boundary outside the agent, where NVIDIA OpenShell fits, and why we plan around NVIDIA Vera.
GLM-5.1 Pricing Guide: API Cost Comparison & Analysis<p>Provider choice for GLM-5.1 is a real economic decision. Across 10 benchmarked API providers, blended pricing runs from $0.74 to $1.70 per 1M tokens, output speed from 33.8 to 175.2 t/s, and the fastest provider is 5.2x quicker than the slowest. For teams deploying at scale, that spread determines whether this model fits a production […]</p>
Kimi K3 vs DeepSeek V4 Pro vs GLM-5.2: Open-Weight AI Model Comparison<p>In the span of three months, three Chinese AI labs shipped open-weight models that individually would have rewritten the frontier story. Together, they signal something more structural: the open-weight tier is no longer a budget alternative to closed models. Kimi K3 (Moonshot AI, July 2026 — now also available through DeepInfra), DeepSeek V4 Pro (DeepSeek, […]</p>
© 2026 DeepInfra. All rights reserved.