Building a Voice Assistant with Whisper, LLM, and TTS

Published on 2024.09.20 by Askar AitzhanBuilding a Voice Assistant with Whisper, LLM, and TTS post image

Learn how to create a voice assistant using Whisper for speech recognition, LLM for conversation, and TTS for text-to-speech.Read More


Seed Anchoring and Parameter Tweaking with SDXL Turbo: Create Stunning Cubist Art

Published on 2024.09.12 by Oguz VuruskanerSeed Anchoring and Parameter Tweaking with SDXL Turbo: Create Stunning Cubist Art post image

In this blog post, we're going to explore how to create stunning cubist art using SDXL Turbo using some advanced image generation techniques.Read More


FLUX.1-dev Guide: Mastering Text-to-Image AI Prompts for Stunning and Consistent Visuals

Published on 2024.09.04 by Oguz VuruskanerFLUX.1-dev Guide: Mastering Text-to-Image AI Prompts for Stunning and Consistent Visuals post image

Learn how to craft compelling prompts for FLUX.1-dev to create stunning images.Read More


Introducing Tool Calling with LangChain, Search the Web with Tavily and Tool Calling Agents

Published on 2024.07.05 by Oguz VuruskanerIntroducing Tool Calling with LangChain, Search the Web with Tavily and Tool Calling Agents post image

In this blog post, we will query for the details of a recently released expansion pack for Elden Ring, a critically acclaimed game released in 2022, using the Tavily tool with the ChatDeepInfra model. Using this boilerplate, one can automate the process of searching for information with well-writt...Read More


Chat with books using DeepInfra and LlamaIndex

Published on 2024.06.07 by Oguz VuruskanerChat with books using DeepInfra and LlamaIndex post image

As DeepInfra, we are excited to announce our integration with LlamaIndex. LlamaIndex is a powerful library that allows you to index and search documents using various language models and embeddings. In this blog post, we will show you how to chat with books using DeepInfra and LlamaIndex. We will ...Read More


Guaranteed JSON output on Open-Source LLMs.

Published on 2024.03.08 by Patrick Reiter HornGuaranteed JSON output on Open-Source LLMs. post image

DeepInfra is proud to announce that we have released "JSON mode" across all of our text language models. It is available through the "response_format" object, which currently supports only {"type": "json_object"} Our JSON mode will guarantee that all tokens returned in the output of a langua...Read More


Deploy Custom LLMs on DeepInfra

Published on 2024.03.01 by Iskren ChernevDeploy Custom LLMs on DeepInfra post image

Did you just finetune your favorite model and are wondering where to run it? Well, we have you covered. Simple API and predictable pricing. Put your model on huggingface Use a private repo, if you wish, we don't mind. Create a hf access token just for the repo for better security. Create c...Read More


Enhancing Open-Source LLMs with Function Calling Feature

Published on 2024.01.26 by Pernekhan UtemuratovEnhancing Open-Source LLMs with Function Calling Feature post image

We're excited to announce that the Function Calling feature is now available on DeepInfra. We're offering Mistral-7B and Mixtral-8x7B models with this feature. Other models will be available soon. LLM models are powerful tools for various tasks. However, they're limited in their ability to per...Read More


Long Context models incoming

Published on 2023.11.21 by Iskren ChernevLong Context models incoming post image

Many users requested longer context models to help them summarize bigger chunks of text or write novels with ease. We're proud to announce our long context model selection that will grow bigger in the comming weeks. Models Mistral-based models have a context size of 32k, and amazon recently r...Read More


Unleashing the Potential of AI for Exceptional Gaming Experiences

Published on 2023.11.10 by Tsveta GavanozovaUnleashing the Potential of AI for Exceptional Gaming Experiences post image

Gaming companies are constantly in search of ways to enhance player experiences and achieve extraordinary outcomes. Recent research indicates that investments in player experience (PX) can result in substantial returns on investment (ROI). By prioritizing PX and harnessing the capabilities of AI...Read More