DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

NVIDIA Nemotron 3.5 Transcribe is now available on DeepInfra, from day zero of its release. It's an open-weight speech model that handles transcription, speaker attribution, speech translation, contextual biasing, and audio understanding in one model. On DeepInfra it's served through the OpenAI-compatible speech-to-text API, with transcription, word and segment timestamps, contextual prompts, and translation into English available today. Speaker attribution in the API is coming soon.
Teams building call analytics, meeting tools, and media products need more than a raw transcript. They need to know who said what, get domain terms right, handle multilingual recordings, and pull answers out of the audio. One way to build this is to chain an ASR model, a diarization model, a translation model, and an LLM. That works, but it adds integration work and makes the pipeline harder to evaluate.
Nemotron 3.5 Transcribe brings those tasks into one model, so a single request can return a transcript shaped for your application.
Many speech tasks, one model. NVIDIA reports 11 speech tasks in a single checkpoint, including multilingual ASR, speech translation, code-switching, speaker attribution, word timestamps, rich transcription with punctuation and casing, and audio understanding. You orchestrate one model instead of several.
Context-aware transcription. Pass domain terms and product names in a short prompt. The model uses that context to help recognize names that general-purpose ASR often misses, such as drug names, product names, or customer names.
Multilingual. NVIDIA reports transcription in 40 languages, speech translation between English and 31 languages, and code-switching across 13 languages. On DeepInfra, translation into English is available through the OpenAI-compatible /audio/translations endpoint.
Long recordings in one request. Send up to 60 minutes of audio in a single request, with no chunking or stitching on your side.
An efficient Mixture-of-Experts (MoE) design. Nemotron 3.5 Transcribe is a Speech-Augmented Language Model (SALM): speech and speaker encoders feed the autoregressive Nemotron 3.5 Lightning MoE backbone. The 30B-A4B design activates about 4B parameters per token.
Built for recorded audio. It's an offline (non-streaming) model, the choice when you're processing recorded calls, meetings, and media, or running a second pass on live-call transcripts.
NVIDIA reports that Nemotron 3.5 Transcribe delivers transcription accuracy on par with leading proprietary speech APIs, with full results in its technical report.
Independent results point the same way. On Cekura's speech-to-text leaderboard, Nemotron 3.5 Transcribe ranks #1 on Ocular WER, an exclusive private dataset Cekura procured, with a 2.48% word error rate, ahead of every proprietary API on the board. A private set is the closest proxy for your own recordings, since no model could have been tuned on it.

On Cekura's public Pipecat WER set, it scores 2.32%, within about half a point of the leader and ahead of Cartesia Ink 2, Speechmatics Linden, Soniox STT-RT v5, and Deepgram Nova-3.

It's the only open-weight model on either leaderboard, so this accuracy comes with weights you can inspect, fine-tune, or run yourself.
Nemotron 3.5 Transcribe runs on DeepInfra's OpenAI-compatible speech-to-text endpoint. Point the OpenAI SDK at DeepInfra, send an audio file, and add a short prompt with the terms that matter for your domain.
import os
from openai import OpenAI
client = OpenAI(
api_key=os.environ["DEEPINFRA_API_KEY"],
base_url="https://api.deepinfra.com/v1/openai",
)
with open("support_call.mp3", "rb") as audio:
transcript = client.audio.transcriptions.create(
model="nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B",
file=audio,
prompt="Customer support call about a GPU cloud bill. "
"Terms: DeepInfra, Nemotron.",
)
print(transcript.text)
For captions or search, ask for word and segment timestamps:
with open("support_call.mp3", "rb") as audio:
transcript = client.audio.transcriptions.create(
model="nvidia/NVIDIA-Nemotron-3.5-Transcribe-30B-A4B",
file=audio,
response_format="verbose_json",
timestamp_granularities=["word", "segment"],
)
for segment in transcript.segments:
print(f"[{segment.start:.1f}s - {segment.end:.1f}s] {segment.text}")
srt and vtt response formats are supported too. To translate speech into English, call client.audio.translations.create with the same model.
Nemotron 3.5 Transcribe costs $0.002 per minute of audio ($0.12 per hour). See the model page and pricing page for current rates.
DeepInfra runs this model with zero data retention: your audio and transcripts aren't stored after the request completes. For details on our security and compliance practices, see the DeepInfra Trust Center.
Explore the model, check current pricing, and make your first API request.
Multi-Turn RL: A Guide to Getting Reinforcement Learning Right<p>The first multi-turn RL run you launch will spend most of its life doing something you would not call training. You watch GPU utilization sit under half, watch a step take eleven minutes, and go hunting for a bug in your gradient accumulation. There is no bug. The trainer is waiting on rollouts. This is […]</p>
NVIDIA Nemotron 3 Super 120B API Benchmarks: Latency & Cost<p>About NVIDIA Nemotron 3 Super 120B A12B NVIDIA’s Nemotron 3 Super 120B A12B is an open-weight large language model released on March 11, 2026. It features 120B total parameters with only 12B active per forward pass, delivering exceptional compute efficiency for complex multi-agent applications such as software development and cybersecurity triaging. The model uses a […]</p>
Model Distillation Making AI Models EfficientAI Model Distillation Definition & Methodology
Model distillation is the art of teaching a smaller, simpler model to perform as well as a larger one. It's like training an apprentice to take over a master's work—streamlining operations with comparable performance . If you're struggling with depl...© 2026 DeepInfra. All rights reserved.