DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

A Milestone on Our Journey Building DeepInfra and Scaling Open Source AI Infrastructure

Published on 2025.04.22 by Yessen Kanapin, Co-Founder of DeepInfra
A Milestone on Our Journey Building DeepInfra and Scaling Open Source AI Infrastructure

Today we're excited to share that DeepInfra has raised $18 million in Series A funding, led by Felicis and our earliest believer and advisor Georges Harik.

When we founded DeepInfra in 2022, we saw a clear gap: while enormous resources were being poured into training AI models, the infrastructure needed to run these models in production was lagging behind.

The past two years have been a whirlwind. We've scaled our processing volume by over 8,000x since our seed stage. What started as a bet on AI infrastructure has quickly become a critical service for developers deploying increasingly sophisticated models.

Our growth accelerated following the emergence of "thinking models" like DeepSeek. These open source alternatives demonstrated that the innovation cycle in AI was becoming even more rapid than anticipated, requiring significantly more computation during inference.

The reality of deploying modern AI models is challenging for most organizations. Running these models requires significant compute resources, specialized hardware like GPUs that are difficult to acquire, and deep expertise in infrastructure optimization. Most companies simply can't afford the investment or overcome the supply chain challenges to build this infrastructure themselves.

This challenge has shaped our approach from day one. After years of scaling systems to hundreds of millions of users before founding this company, we've developed a set of core principles that guide how we build DeepInfra:

  1. We believe reliability is non-negotiable when your service powers critical applications. We design for zero downtime because AI infrastructure must be as dependable as the electricity powering your office.
  2. We've learned that performance creates competitive advantage. Our obsession with fast time-to-first-token and optimal GPU utilization isn't technical vanity – it directly impacts our customers' user experience and cost structure.
  3. We're convinced that privacy builds lasting trust. Our strict no-logging policy for user prompts isn't just a feature – it's a fundamental commitment to our customers' data sovereignty.
  4. And we know that deep infrastructure expertise matters at every layer. Understanding the full stack from hardware to application allows us to deliver superior performance while controlling costs.

These principles have guided our approach as we've expanded our computing capacity, recently receiving a large shipment of NVIDIA Blackwell GPUs with more on order to support our rapid growth. You can see how this funding injection will be put to good use.

To our customers who have trusted us with their production workloads: thank you. We're just getting started as we continue building the infrastructure that powers the next generation of AI applications.

Follow us on X (formerly Twitter) and LinkedIn to stay updated on our journey. We look forward to sharing more exciting developments in the coming months.

Servers

Related articles
GLM-5.1 Pricing Guide: API Cost Comparison & AnalysisGLM-5.1 Pricing Guide: API Cost Comparison & Analysis<p>Provider choice for GLM-5.1 is a real economic decision. Across 10 benchmarked API providers, blended pricing runs from $0.74 to $1.70 per 1M tokens, output speed from 33.8 to 175.2 t/s, and the fastest provider is 5.2x quicker than the slowest. For teams deploying at scale, that spread determines whether this model fits a production [&hellip;]</p>
Build a Streaming Chat Backend in 10 MinutesBuild a Streaming Chat Backend in 10 Minutes<p>When large language models move from demos into real systems, expectations change. The goal is no longer to produce clever text, but to deliver predictable latency, responsive behavior, and reliable infrastructure characteristics. In chat-based systems, especially, how fast a response starts often matters more than how fast it finishes. This is where token streaming becomes [&hellip;]</p>
How to deploy google/flan-ul2 - simple. (open source ChatGPT alternative)How to deploy google/flan-ul2 - simple. (open source ChatGPT alternative)Flan-UL2 is probably the best open source model available right now for chatbots. In this post we will show you how to get started with it very easily. Flan-UL2 is large - 20B parameters. It is fine tuned version of the UL2 model using Flan dataset. Because this is quite a large model it is not eas...