We use essential cookies to make our site work. With your consent, we may also use non-essential cookies to improve user experience and analyze website traffic…

DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

GLM-5 API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraGLM-5 API Benchmarks: Latency, Throughput & Cost

GLM-5 is the latest open-weights reasoning model released by Z AI (Zhipu AI) in February 2026, characterized by high “thinking token” usage. It is a Mixture of Experts (MoE) model with 744B total parameters and 40B active parameters, scaling up from GLM-4.5’s 355B parameters. The model was pre-trained on 28.5T tokens and features a 200K+ […]

Introducing Nemotron 3 Super on DeepInfraPublished on 2026.03.11 by Aray SultanbekovaIntroducing Nemotron 3 Super on DeepInfra

DeepInfra is an official launch partner for NVIDIA Nemotron 3 Super, the latest open model in the Nemotron family, purpose-built for complex multi-agent applications with a 1M token context window and hybrid MoE architecture.

Building Efficient AI Inference on NVIDIA Blackwell PlatformPublished on 2026.02.12 by DeepInfraBuilding Efficient AI Inference on NVIDIA Blackwell Platform

DeepInfra delivers up to 20x cost reductions on NVIDIA Blackwell by combining MoE architectures, NVFP4 quantization, and inference optimizations — with a Latitude case study.

Function Calling in DeepInfra: Extend Your AI with Real-World LogicPublished on 2026.02.02 by DeepInfraFunction Calling in DeepInfra: Extend Your AI with Real-World Logic

Modern large language models (LLMs) are incredibly powerful at understanding and generating text, but until recently they were largely static: they could only respond based on patterns in their training data. Function calling changes that. It lets language models interact with external logic — your own code, APIs, utilities, or business systems — while still […]

Build a Streaming Chat Backend in 10 MinutesPublished on 2026.02.02 by DeepInfraBuild a Streaming Chat Backend in 10 Minutes

When large language models move from demos into real systems, expectations change. The goal is no longer to produce clever text, but to deliver predictable latency, responsive behavior, and reliable infrastructure characteristics. In chat-based systems, especially, how fast a response starts often matters more than how fast it finishes. This is where token streaming becomes […]

Reliable JSON-Only Responses with DeepInfra LLMsPublished on 2026.02.02 by DeepInfraReliable JSON-Only Responses with DeepInfra LLMs

When large language models are used inside real applications, their role changes fundamentally. Instead of chatting with users, they become infrastructure components: extracting information, transforming text, driving workflows, or powering APIs. In these scenarios, natural language is no longer the desired output. What applications need is structured data — and very often, that structure is […]