Category: LLMs

In this article, we create a multimodal chat interface with Gradio to chat with images and videos using Phi-3.5 Vision Instruct model. ...

In this article, we use LitGPT, LitAPI, and LitServe for serving LLMs using Lightning Studio and also on the local system. ...

In this article, we are adding a custom model to Ollama. We take a fine-tuned Hugging Face model, StarCoder2-3B, convert it to GGUF format, add it to local Ollama, and push the model to Ollama hub. ...

In this article, we fine tune the StarCoder2-3B model on an instruction tuning dataset to create a small, performant, and fast local coding LLM. ...

In this article, we explore the important components of the Starcoder and Starcoder 2 paper including the model architecture, the datasets, and benchmark. ...