Simple Pricing, Deep Infrastructure
We have different pricing models depending on the model used. Some of our langauge models offer per token pricing. Most other models are billed for inference execution time. With this pricing model, you only pay for what you use. There are no long-term contracts or upfront costs, and you can easily scale up and down as your business needs change.Token Pricing
$0.70
/ 1M input tokens$0.95
/ 1M output tokens (50% less than ChatGPT-3.5 Turbo)Llama-2-70b-chat
| Model | Context | $ per 1M input tokens | $ per 1M output tokens |
|---|---|---|---|
| Llama-2-70b-chat | - | - | - |
| CodeLlama-34b-Instruct | - | - | - |
| Llama-2-13b-chat | - | - | - |
| Llama-2-7b-chat | - | - | - |
| Mistral-7B | - | - | - |
| Airoboros-70b | - | - | - |
| Lzlv-70b | - | - | - |
Execution Time Pricing
$0.0005
/second$0.03
/minute (55% less than Replicate)Nvidia A100 GPU
billed per millisecond of inference execution time
only pay for the inference time not idle time
1 hour free
Hardware
All models run on A100 GPUs, optimized for inference performance and low latency.
Auto Scaling
Our system will automatically scale the model to more hardware based on your needs. To eliminate any cold starts you can also reserve GPU memory at $0.04 per GB / hour
Billing
Each inference request time is calculated with millisecond precision and added to your account. Once per month we charge you for the time you've used. You can find your current usage in your account.
