DeepInfra raises $107M Series B to scale the inference cloud — read the announcement

Compare Llama2 vs OpenAI models for FREE.

Published on 2023.09.28 by Nikola Borisov
Compare Llama2 vs OpenAI models for FREE.

At DeepInfra we host the best open source LLM models. We are always working hard to make our APIs simple and easy to use.

Today we are excited to announce a very easy way to quickly try our models like Llama2 70b and Mistral 7b and compare them to OpenAI's models. You only need to change the API endpoint URL and the model name to quickly see if these models are a good fit for your application.

Here is a quick example of how to use the OpenAI Python client with our models:

import openai

# Point OpenAI client to our endpoint
openai.api_base = "https://api.deepinfra.com/v1/openai"
# Just leave the API key empty. You don't need it to try our models. 
openai.api_key = ""

# Your chosen model here
MODEL_DI = "meta-llama/Llama-2-70b-chat-hf"
chat_completion = openai.ChatCompletion.create(
    model="meta-llama/Llama-2-70b-chat-hf",
    messages=[{"role": "user", "content": "Hello world"}],
    stream=True,
)

# print the chat completion
for event in chat_completion:
    print(event.choices)
copy

Rate limits on no API key

To make it as simple as possible you don't even have to create an account with DeepInfra to try our models. Just pass empty string as api_key and you are good to go. We rate limit the unauthenticated requests by IP address.

Pricing and Production ready

When you are ready to use our models in production, you can create an account at DeepInfra and get an API key. We offer the best pricing for the llama 2 70b model at just $1 per 1M tokens. If you need any help, just reach out to us on our Discord server.

Related articles
MiniMax-M2.5 API Benchmarks: Latency, Throughput & CostMiniMax-M2.5 API Benchmarks: Latency, Throughput & Cost<p>About MiniMax-M2.5 MiniMax-M2.5 is a state-of-the-art open-weights large language model released in February 2026. Built on a 230B-parameter Mixture of Experts (MoE) architecture with approximately 10 billion active parameters per forward pass, it features Lightning Attention and supports a context window of up to 205,000 tokens. The model uses extended chain-of-thought reasoning to work through [&hellip;]</p>
DeepSeek V4 Pro 0813 API Benchmarks: Speed, Latency & CostDeepSeek V4 Pro 0813 API Benchmarks: Speed, Latency & Cost<p>Updated November 2026 for the DeepSeek-V4-Pro-0813 release. About DeepSeek V4 Pro 0813 DeepSeek-V4-Pro-0813 is the general-availability release of DeepSeek V4 Pro, published by DeepSeek on August 13, 2026. It supersedes the April preview and keeps the same Mixture-of-Experts base: 1.6 trillion total parameters, 49 billion active per token, and a 1M-token context window. What&#8217;s new [&hellip;]</p>
GLM-5.1 Model Overview: Features, Capabilities & Use CasesGLM-5.1 Model Overview: Features, Capabilities & Use Cases<p>Updated November 2026. GLM-5.1 has been retired on DeepInfra. Its successor, GLM-5.3, is available now; see the GLM-5.3 model overview and integration guide for current details. The overview below is kept for reference. GLM-5.1 is Z.AI&#8217;s next-generation flagship model for agentic engineering, released on April 7, 2026 under the MIT license. It is a 754-billion [&hellip;]</p>