We use essential cookies to make our site work. With your consent, we may also use non-essential cookies to improve user experience and analyze website traffic…

DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Qwen3.5 397B A17B API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraQwen3.5 397B A17B API Benchmarks: Latency, Throughput & Cost

About Qwen3.5 397B A17B Qwen3.5 397B A17B is Alibaba Cloud’s largest and most capable multimodal foundation model, released in February 2026. It features a hybrid Mixture-of-Experts (MoE) architecture with 397 billion total parameters and 17 billion active parameters per inference pass, utilizing 512 experts with a routing mechanism selecting a subset per token. This sparse […]

Step 3.5 Flash API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraStep 3.5 Flash API Benchmarks: Latency, Throughput & Cost

About Step 3.5 Flash Step 3.5 Flash is an open-weights reasoning model released in February 2026 by StepFun. It leverages a sparse Mixture of Experts (MoE) architecture with 196 billion total parameters and only 11 billion active parameters per token during inference — delivering state-of-the-art performance at a fraction of the cost of dense models. […]

NVIDIA Nemotron 3 Super 120B API Benchmarks: Latency & CostPublished on 2026.04.03 by DeepInfraNVIDIA Nemotron 3 Super 120B API Benchmarks: Latency & Cost

About NVIDIA Nemotron 3 Super 120B A12B NVIDIA’s Nemotron 3 Super 120B A12B is an open-weight large language model released on March 11, 2026. It features 120B total parameters with only 12B active per forward pass, delivering exceptional compute efficiency for complex multi-agent applications such as software development and cybersecurity triaging. The model uses a […]

GLM-4.7-Flash API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraGLM-4.7-Flash API Benchmarks: Latency, Throughput & Cost

About GLM-4.7-Flash GLM-4.7-Flash is Z.AI’s open-weights reasoning model released in January 2026. Built on a Mixture-of-Experts (MoE) Transformer architecture, it features 30 billion total parameters with only ~3 billion active per inference — making it exceptionally efficient for its capability class. The model is designed as a lightweight, cost-effective alternative to Z.AI’s flagship GLM-4.7, optimized […]

Kimi K2.5 API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraKimi K2.5 API Benchmarks: Latency, Throughput & Cost

About Kimi K2.5 Kimi K2.5 is Moonshot AI’s flagship open-source reasoning model, released in January 2026. It is a native multimodal agentic model built through continual pretraining on approximately 15 trillion mixed visual and text tokens. The model features a Mixture-of-Experts (MoE) architecture with 1 trillion total parameters and 32 billion activated parameters. Kimi K2.5 […]

MiniMax-M2.5 API Benchmarks: Latency, Throughput & CostPublished on 2026.04.03 by DeepInfraMiniMax-M2.5 API Benchmarks: Latency, Throughput & Cost

About MiniMax-M2.5 MiniMax-M2.5 is a state-of-the-art open-weights large language model released in February 2026. Built on a 230B-parameter Mixture of Experts (MoE) architecture with approximately 10 billion active parameters per forward pass, it features Lightning Attention and supports a context window of up to 205,000 tokens. The model uses extended chain-of-thought reasoning to work through […]