Templateslocalai
ai
localai
Self-hosted, OpenAI-compatible REST API for running LLMs, image generation, audio transcription, and embeddings locally — no GPU required.
aiutilities
What gets deployed
Web
localai server
GitHub stars30,000
About
Self-hosted, OpenAI-compatible REST API for running LLMs, image generation, audio transcription, and embeddings locally — no GPU required.
Environment Variables
| Variable | Description | Required |
|---|---|---|
| MODELS_PATH | Default: /models | Optional |
| CONTEXT_SIZE | Default: 512 | Optional |
| THREADS | Default: 4 | Optional |
| DEBUG | Default: false | Optional |
Deploy localai
One click to deploy a fully configured localai instance with all dependencies pre-wired.
Deploy NowReady to deploy localai?
No infrastructure to manage. Just connect your repo and go live in seconds.