🚀 New models by Bria.ai, generate and edit images at scale 🚀
Published on 2023.11.02 by Nikola BorisovLzlv model for roleplaying and creative workRecently an interesting new model got released.
It is called Lzlv, and it is basically
a merge of few existing models. This model is using the Vicuna prompt format, so keep this
in mind if you are using our raw [API](/lizpreciatior/lzlv_70b...
Published on 2023.10.25 by Iskren ChernevLangchain improvements: async and streamingStarting from langchain
v0.0.322 you
can make efficient async generation and streaming tokens with deepinfra.
Async generation
The deepinfra wrapper now supports native async calls, so you can expect more
performance (no more t...
Published on 2023.09.28 by Nikola BorisovCompare Llama2 vs OpenAI models for FREE.At DeepInfra we host the best open source LLM models. We are always working hard to make
our APIs simple and easy to use.
Today we are excited to announce a very easy way to quickly try our models like
Llama2 70b and
[Mistral 7b](/mistralai/Mistral-7B-Instruc...
Published on 2023.08.28 by Iskren ChernevUse OpenAI API clients with LLaMasGetting started
# create a virtual environment
python3 -m venv .venv
# activate environment in current shell
. .venv/bin/activate
# install openai python client
pip install openai
Choose a model
meta-llama/Llama-2-70b-chat-hf
[meta-llama/L...
Published on 2023.08.09 by Nikola BorisovFork of Text Generation Inference.The text generation inference open source project by huggingface looked like a promising
framework for serving large language models (LLM). However, huggingface announced that they
will change the license of code with version v1.0.0. While the previous license Apache 2.0
was permissive, the new on...
Published on 2023.08.02 by Nikola BorisovThe easiest way to build AI applications with Llama 2 LLMs.The long awaited Llama 2 models are finally here!
We are excited to show you how to use them with DeepInfra. These collection of models represent
the state of the art in open source language models.
They are made available by Meta AI and the l...© 2025 Deep Infra. All rights reserved.