The easiest way to build AI applications with Llama 2 LLMs.

Published on 2023.08.02 by Nikola BorisovThe easiest way to build AI applications with Llama 2 LLMs. post image

The long awaited Llama 2 models are finally here! We are excited to show you how to use them with DeepInfra. These collection of models represent the state of the art in open source language models. They are made available by Meta AI and the l...Read More


How to deploy Databricks Dolly v2 12b, instruction tuned casual language model.

Published on 2023.04.12 by Yessen KanapinHow to deploy Databricks Dolly v2 12b, instruction tuned casual language model. post image

Databricks Dolly is instruction tuned 12 billion parameter casual language model based on EleutherAI's pythia-12b. It was pretrained on The Pile, GPT-J's pretraining corpus. [databricks-dolly-15k](http...Read More


How to OpenAI Whisper with per-sentence and per-word timestamp segmentation using DeepInfra

Published on 2023.04.05 by Yessen KanapinHow to OpenAI Whisper with per-sentence and per-word timestamp segmentation using DeepInfra post image

Whisper is a Speech-To-Text model from OpenAI.Read More


How to deploy google/flan-ul2 - simple. (open source ChatGPT alternative)

Published on 2023.03.17 by Nikola BorisovHow to deploy google/flan-ul2 - simple. (open source ChatGPT alternative) post image

Flan-UL2 is probably the best open source model available right now for chatbots. In this post we will show you how to get started with it very easily. Flan-UL2 is large - 20B parameters. It is fine tuned version of the UL2 model using Flan dataset. Because this is quite a large model it is not eas...Read More


A short intro on running Stable Diffusion on DeepInfra

Published on 2023.03.08 by IskrenA short intro on running Stable Diffusion on DeepInfra post image

I'm glad you askedRead More


Getting Started

Published on 2023.03.02 by Nikola BorisovGetting Started post image

Installation This is easy, just get our deepctl command line tool installed on your machine. Here is how to run it: curl https://deepinfra.com/get.sh | sh Make sure all is well by running: deepctl --version Login to DeepInfra (using your GitHub...Read More