Blog | Fast & Reliable AI Inference

DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Open-Weight Model Licenses: What to Check Before You Ship

Recent articles

Published on 2026.10.15 by Stefan FidanovTypeSafe Jev Review: Testing 5 Jobs on a Non-Chat Model

Jev is an AI model from TypeSafe that makes decisions instead of writing text. A chatbot like ChatGPT reads your prompt and generates an answer word by word. Jev reads a piece of text, such as a support ticket or a request from an AI agent, plus questions you’ve written about it, and hands back […]

Published on 2026.10.15 by NiklasAI Spend Audit: How to Reduce Costs With Open Models

In 2026, mentions of open-weight or open-source models on US earnings calls and at investor conferences ran about six times higher compared to the last year. The companies doing the talking are no longer only tech firms. PNC, CH Robinson and Siemens have all discussed open-weight models in recent weeks. The clearest example is Tinder. […]

Published on 2026.10.15 by Aray SultanbekovaFrom Screenshots to Tool Calls: NVIDIA Nemotron 3.5 Super VL on DeepInfra

NVIDIA Nemotron 3.5 Super VL, the new open multimodal model in the Nemotron family, is available on DeepInfra from day zero. It brings visual understanding, reasoning, and tool calling together in one model, through an OpenAI-compatible API with pay-per-token pricing.

Published on 2026.10.14 by Stefan FidanovWestern Open-Weight Models: Beam and Le Chonk

Reflection AI and Mistral shipped open-weight flagships a day apart in the first week of October, and both say they compare to the best China has to offer. Reflection’s Beam is a 501B-parameter workhorse that claims GLM-5.2-level reasoning, a bar Z.ai has already raised with GLM-5.3, on a fraction of the inference compute. Mistral’s Large […]

Published on 2026.10.13 by NiklasDecision Models: The Fast Layer for AI Agents

There is a decision your agent makes dozens of times per session that you are probably paying a frontier model to handle. Should this request go to the fast cheap model or the expensive one? Is this tool call safe to execute? Is the task actually finished, or does the agent think it is finished? […]

Published on 2026.10.10 by DeepInfraBest Qwen3.8-27B Inference Providers (2026)

Qwen3.8-27B has shifted the landscape of open-weight models. It strikes an exceptional balance between parameter count and reasoning capability: a 27-billion parameter model that is highly capable yet compact. It runs on a single 24GB card at 4-bit quantization, or a single 80GB card at full precision. Finding the right infrastructure to host, scale, or […]