DeepInfra raises $107M Series B to scale the inference cloud — read the announcement
Published on 2026.04.03 by DeepInfraGLM-5 API Benchmarks: Latency, Throughput & CostGLM-5 is the latest open-weights reasoning model released by Z AI (Zhipu AI) in February 2026, characterized by high “thinking token” usage. It is a Mixture of Experts (MoE) model with 744B total parameters and 40B active parameters, scaling up from GLM-4.5’s 355B parameters. The model was pre-trained on 28.5T tokens and features a 200K+ […]
Published on 2026.03.11 by Aray SultanbekovaIntroducing Nemotron 3 Super on DeepInfraDeepInfra is an official launch partner for NVIDIA Nemotron 3 Super, the latest open model in the Nemotron family, purpose-built for complex multi-agent applications with a 1M token context window and hybrid MoE architecture.
Published on 2026.02.12 by DeepInfraBuilding Efficient AI Inference on NVIDIA Blackwell PlatformDeepInfra delivers up to 20x cost reductions on NVIDIA Blackwell by combining MoE architectures, NVFP4 quantization, and inference optimizations — with a Latitude case study.
Published on 2026.02.02 by DeepInfraFunction Calling in DeepInfra: Extend Your AI with Real-World LogicModern large language models (LLMs) are incredibly powerful at understanding and generating text, but until recently they were largely static: they could only respond based on patterns in their training data. Function calling changes that. It lets language models interact with external logic — your own code, APIs, utilities, or business systems — while still […]
Published on 2026.02.02 by DeepInfraBuild a Streaming Chat Backend in 10 MinutesWhen large language models move from demos into real systems, expectations change. The goal is no longer to produce clever text, but to deliver predictable latency, responsive behavior, and reliable infrastructure characteristics. In chat-based systems, especially, how fast a response starts often matters more than how fast it finishes. This is where token streaming becomes […]
Published on 2026.02.02 by DeepInfraReliable JSON-Only Responses with DeepInfra LLMsWhen large language models are used inside real applications, their role changes fundamentally. Instead of chatting with users, they become infrastructure components: extracting information, transforming text, driving workflows, or powering APIs. In these scenarios, natural language is no longer the desired output. What applications need is structured data — and very often, that structure is […]
© 2026 DeepInfra. All rights reserved.