Templateslitellm
litellm
ai

litellm

LLM proxy and gateway — unified OpenAI-compatible API for 100+ providers including OpenAI, Anthropic, Gemini, Ollama, and Bedrock with cost tracking and rate limiting.

aidevelopmentutilitiesPostgreSQL
Deploy litellmVisit websiteView on GitHub

What gets deployed

Web

litellm server

PostgreSQL

managed database

GitHub stars24,000

About

LLM proxy and gateway — unified OpenAI-compatible API for 100+ providers including OpenAI, Anthropic, Gemini, Ollama, and Bedrock with cost tracking and rate limiting.

Managed services

  • PostgreSQLTCP:5432

Environment Variables

VariableDescriptionRequired
DATABASE_URLDefault: postgresql://litellm:litellm@{{KUBERO_APP_NAME}}-postgresql-rw:5432/litellmOptional
LITELLM_MASTER_KEYDefault: sk-change-meOptional
STORE_MODEL_IN_DBDefault: trueOptional
LITELLM_LOGDefault: INFOOptional
UI_USERNAMEDefault: adminOptional
UI_PASSWORDDefault: change-meOptional

Deploy litellm

One click to deploy a fully configured litellm instance with all dependencies pre-wired.

Deploy Now

Source

Upstream project
Template definition

Related docs

Deploy from GitHubEnvironment variablesPersistent disksCustom domains

Ready to deploy litellm?

No infrastructure to manage. Just connect your repo and go live in seconds.

Deploy litellmBrowse all templates