Fast ML Inference, Simple API
Run the top AI models using a simple API, pay per use. Low cost, scalable and production ready infrastructure.
$0.7 per 1M input tokens
How to deploy Deep Infra in seconds
Powerful, self-serve machine learning platform where you can turn models into scalable APIs in just a few clicks.
Download deepctl
Sign up for Deep Infra account using github or Login using github
Deploy a model
Choose among hundreds of the most popular ML models
Call Your Model in Production
Use a simple rest API to call your model.
Deepinfra Benefits
Deploy models to production faster and cheaper with our serverless GPUs than developing the infrastructure yourself.
Low Latency
Model is deployed in multiple regions
Close to the user
Fast network
Autoscaling
Cost Effective
Share resources
Pay per use
Simple pricing
Serverless
No ML Ops needed
Better cost efficiency
Hassle free ML infrastructure
Simple
No ML Ops needed
Better cost efficiency
Hassle free ML infrastructure
Auto Scaling
Fast scaling infrastructure
Maintain low latency
Scale down when not needed
Run costs
Simple Pricing, Deep Infrastructure
We have different pricing models depending on the model used. Some of our langauge models offer per token pricing. Most other models are billed for inference execution time. With this pricing model, you only pay for what you use. There are no long-term contracts or upfront costs, and you can easily scale up and down as your business needs change.Token Pricing
$0.70
/ 1M input tokens$0.95
/ 1M output tokens (50% less than ChatGPT-3.5 Turbo)| Model | Context | $ per 1M input tokens | $ per 1M output tokens |
|---|---|---|---|
| Llama-2-70b-chat | - | - | - |
| CodeLlama-34b-Instruct | - | - | - |
| Llama-2-13b-chat | - | - | - |
| Llama-2-7b-chat | - | - | - |
| Mistral-7B | - | - | - |
| Airoboros-70b | - | - | - |
| Lzlv-70b | - | - | - |
Execution Time Pricing
$0.0005
/second$0.03
/minute (55% less than Replicate)billed per millisecond of inference execution time
only pay for the inference time not idle time
1 hour free
Hardware
All models run on A100 GPUs, optimized for inference performance and low latency.
Auto Scaling
Our system will automatically scale the model to more hardware based on your needs. To eliminate any cold starts you can also reserve GPU memory at $0.04 per GB / hour
Billing
Each inference request time is calculated with millisecond precision and added to your account. Once per month we charge you for the time you've used. You can find your current usage in your account.
