The free, OpenAI and Anthropic alternative. A small, composable AI stack. - Run powerful language models, autonomous agents, and document intelligence locally on your hardware. A lean core that pulls model backends on demand, so you install only what you use.
No cloud, no limits, no compromise.
Tip
⭐ Star us on GitHub - 40k+ stars and growing!
Drop-in replacement for OpenAI API - modular suite of tools that work seamlessly together or independently.
Start with LocalAI’s OpenAI-compatible API, extend with LocalAGI’s autonomous agents, and enhance with LocalRecall’s semantic search - all running locally on your hardware.
Open Source MIT Licensed.
Why Choose LocalAI?
OpenAI API Compatible - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud.
Key Features
LLM Inferencing: LocalAI is a free,- Open SourceOpenAI alternative. Run- LLMs, generate- images,- audioand more- locallywith consumer grade hardware.
Agentic-first: Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. Build and deploy autonomous agents with ease.
Memory and Knowledge base: Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications.
OpenAI Compatible: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries.
No GPU Required: Run on consumer grade hardware. No need for expensive GPUs or cloud services.
Multiple Models: Support for various model families including LLMs, image generation, and audio models. Supports multiple backends for inferencing.
Privacy Focused: Keep your data local. No data leaves your machine, ensuring complete privacy.
Easy Setup: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation.
Community Driven: Active community support and regular updates. Contribute and help shape the future of LocalAI.
Quick Start
Docker is the recommended installation method for most users:
For complete installation instructions, see the Installation guide.
Get Started
Install LocalAI- Choose your installation method (Docker recommended)
Quickstart Guide- Get started quickly after installation
Install and Run Models- Learn how to work with AI models