LM Studio is an easy-to-use desktop app for experimenting with local and open-source Large Language Models (LLMs).

LM Studio supports any ggml Llama, MPT, and StarCoder model on Hugging Face (Llama 2, Orca, Vicuna, Nous Hermes, WizardCoder, MPT, etc.)

• Run LLMs on your laptop, entirely offline
• Use models through the in-app Chat UI or an OpenAI compatible local server
• Download any compatible model files from HuggingFace 🤗 repositories
• Discover new & noteworthy LLMs in the app's home page

LM Studio is free