Documentation

  1. Introduction
    1. Getting Started
    2. Models
    3. Inference
    4. OpenAI API
    5. DeepInfra API
    6. Data Privacy

  2. Advanced topics

    1. deepctl cli tool
    2. Rate Limits
    3. Webhooks
    4. Custom LLMs
    5. Log Probabilities
    6. Function Calling
    7. JSON Mode
    8. AI SDK
    9. AutoGen
    10. LangChain
    11. LlamaIndex
    12. Deprecated models
    13. Okta SSO
    14. LoRA adapter model
    15. Scoped JWT
  3. Tutorials
    1. LLaVa model
    2. Stable Diffusion (Text to Image)
    3. Whisper
  4. Miscellaneous
    1. Data Subprocessors

Contents

  1. Introduction
    1. Getting Started
    2. Models
    3. Inference
    4. OpenAI API
    5. DeepInfra API
    6. Data Privacy

  2. Advanced topics

    1. deepctl cli tool
    2. Rate Limits
    3. Webhooks
    4. Custom LLMs
    5. Log Probabilities
    6. Function Calling
    7. JSON Mode
    8. AI SDK
    9. AutoGen
    10. LangChain
    11. LlamaIndex
    12. Deprecated models
    13. Okta SSO
    14. LoRA adapter model
    15. Scoped JWT
  3. Tutorials
    1. LLaVa model
    2. Stable Diffusion (Text to Image)
    3. Whisper
  4. Miscellaneous
    1. Data Subprocessors

Advanced topics

DeepInfra also supports advanced use cases which are covered in the following topics.

Data Privacydeepctl cli tool

Latest Models

Gryphe/

MythoMax-L2-13b

bigcode/

starcoder2-15b

openchat/

openchat_3.5

openai/

whisper-tiny

Phind/

Phind-CodeLlama-34B-v2

Featured Models

distil-whisper/

distil-large-v3

black-forest-labs/

FLUX-pro

openai/

whisper-large-v3

meta-llama/

Meta-Llama-3.1-405B-Instruct

openai/

whisper-large-v3-turbo

meta-llama/

Meta-Llama-3.1-8B-Instruct-Turbo

Company

Pricing

Docs

Compare

DeepStart

About

Careers

Privacy

Terms

Footer Logo

© 2025 Deep Infra. All rights reserved.

Discord Logo