[{"data":1,"prerenderedAt":117},["ShallowReactive",2],{"seo-verification":3,"marketplace-app-en-litellm":6},{"google":4,"bing":5},"EycwPY2XMyTkVzas3n1ygeNJFGAH513qrMjfDljzsMQ","",{"slug":7,"slugs":8,"categorySlugs":9,"name":13,"description":14,"phase":15,"unavailableReason":16,"docsUrl":17,"logo":18,"github":19,"tagline":20,"longDescription":21,"features":22,"useCases":29,"steps":39,"faq":58,"specs":77,"compatibleOs":85,"relatedApps":87,"relatedPosts":110,"category":114},"litellm",{"fr":7,"en":7,"ar":7},{"fr":10,"en":11,"ar":12},"ia","artificial-intelligence","الذكاء-الاصطناعي","LiteLLM","Self-hosted OpenAI-compatible API gateway for 100+ LLMs — route between Ollama, Anthropic, Azure and more from a single endpoint, with per-key rate limits and spend tracking.",1,null,"https:\u002F\u002Fservorbit.com\u002Fblog\u002Fself-host-litellm-on-a-vps-your-private-llm-api-gateway","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F132372032","https:\u002F\u002Fgithub.com\u002FBerriAI\u002Flitellm","Self-hosted LLM API gateway — route between Ollama, Anthropic and 100+ providers from a single OpenAI-compatible endpoint.","LiteLLM is an open-source LLM proxy that presents a unified OpenAI-compatible API for over 100 LLM providers. Your applications keep a single endpoint — and LiteLLM routes each request to Ollama on the same VPS, to Anthropic Claude, to Azure OpenAI, or to any other backend you configure — without a single line of application code changing.\n\nDeployed on a ServOrbit VPS, LiteLLM gives your development team a private AI gateway with a built-in dashboard for usage analytics, per-key spend limits and rate limiting. It runs alongside Ollama for fully air-gapped inference, or in front of commercial APIs to centralize cost tracking across all your projects.",[23,24,25,26,27,28],"OpenAI-compatible REST API — drop-in replacement, works with every SDK that speaks OpenAI","100+ LLM providers: Ollama, Anthropic, OpenAI, Azure, Mistral, Cohere, Bedrock and more","Per-key rate limiting and budget caps — block runaway costs in multi-team or multi-project setups","Real-time spend analytics and cost dashboard with per-model and per-key breakdowns","Load balancing and automatic failover across provider endpoints","Apache 2.0 — fully auditable, no telemetry, air-gap capable with Ollama",[30,33,36],{"title":31,"body":32},"Multi-model AI backend","Route cost-sensitive tasks to a local Ollama instance and complex reasoning requests to Anthropic Claude — all from the same OpenAI SDK call in your application. Change the routing in the LiteLLM config, never in app code.",{"title":34,"body":35},"Team AI budget control","Issue virtual API keys to each team or project with a monthly spend cap. When a key hits its budget, LiteLLM returns a 429 — no surprise cloud bill at the end of the month.",{"title":37,"body":38},"LLM provider migration","Switch your entire application from one provider to another by updating a config file. OpenAI-compatible surface means zero application changes — migrate from GPT-4 to Llama 3 on Ollama without touching a single import.",[40,43,46,49,52,55],{"title":41,"body":42},"Order the VPS","A ServOrbit VPS with 1 GB of RAM is enough for individual use: LiteLLM itself uses around 256 MB, and PostgreSQL takes most of the rest. Allow 2 GB for a team sending requests in parallel. Plan for the domain through which the gateway will be reached as well: there is no other way to it.",{"title":44,"body":45},"Let the installation generate the secrets","You have nothing to craft by hand: the deployment generates the `LITELLM_MASTER_KEY` master key, the PostgreSQL database credentials and the admin interface password. The master key opens the dashboard and every administrative endpoint — treat it as a password and keep it off the server.",{"title":47,"body":48},"Log in for the first time","Open the admin interface at `https:\u002F\u002F\u003Cyour-domain>\u002Fui`: LiteLLM shows a username and password form. Enter `admin` and the password generated at install time, shown on the app's card in your client area, then create your virtual keys from the dashboard.",{"title":50,"body":51},"What the installation deploys","Two containers start together: the `ghcr.io\u002Fberriai\u002Flitellm:main-latest` gateway, published on `127.0.0.1:4000`, and a `postgres:16-alpine` database. Data persists in two volumes, `litellm_db` for the database and `litellm_config` for the gateway configuration. Allow around thirty seconds for the first start.",{"title":53,"body":54},"Declare your first model","In the dashboard, open Models then Add. To route to an Ollama installed on the same machine, enter a model name such as `ollama\u002Fllama3.1` with the base URL `http:\u002F\u002Fhost.docker.internal:11434`; for a remote provider, paste the matching API key, for `anthropic\u002Fclaude-3-5-haiku-20241022` for example. Check with `curl -H \"Authorization: Bearer \u003CLITELLM_MASTER_KEY>\" https:\u002F\u002F\u003Cyour-domain>\u002Fv1\u002Fmodels`: that same address, `https:\u002F\u002F\u003Cyour-domain>\u002Fv1`, is the base URL to give your SDKs.",{"title":56,"body":57},"Issue keys to your teams","In the API Keys section of the dashboard, create one virtual key per team, with a `max_budget` where relevant — the cumulative budget, expressed in dollars —, a `tpm_limit` in tokens per minute and an `rpm_limit` in requests per minute. Your developers point their OpenAI SDK at the gateway, and spend is accounted for key by key.",[59,62,65,68,71,74],{"q":60,"a":61},"What is LiteLLM?","LiteLLM is an open-source LLM proxy (Apache 2.0) that exposes a unified OpenAI-compatible API for over 100 LLM providers — Ollama, Anthropic Claude, OpenAI GPT-4, Azure OpenAI, Mistral, Cohere and more. It sits between your applications and any LLM backend, handling routing, rate limiting and cost tracking.",{"q":63,"a":64},"How much RAM does LiteLLM need?","LiteLLM itself needs around 256 MB. PostgreSQL (for usage tracking and analytics) adds another 256–512 MB. A 1 GB VPS is the minimum for a comfortable single-user setup; 2 GB is recommended for team deployments with concurrent requests.",{"q":66,"a":67},"Can LiteLLM work with my Ollama instance?","Yes. Add Ollama as a provider in the LiteLLM dashboard — set the base URL to `http:\u002F\u002Fhost.docker.internal:11434` (Docker adds this host automatically). Any app using the OpenAI SDK can then call your Ollama models through LiteLLM without changing a single import.",{"q":69,"a":70},"How do I limit spending per team?","Create virtual API keys in the LiteLLM dashboard and set `max_budget` in USD. When a key's cumulative spend reaches the cap, LiteLLM returns a 429. You can also set `tpm_limit` (tokens per minute) and `rpm_limit` (requests per minute) per key for rate-based control.",{"q":72,"a":73},"Is there a built-in dashboard?","Yes. LiteLLM ships a web UI at `\u002Fui` on port 4000. It shows real-time spend by key and by model, request logs, latency breakdowns, and lets you manage models, virtual keys and team budgets — no separate deployment needed.",{"q":75,"a":76},"Does LiteLLM work air-gapped with local models only?","Yes. Configure only Ollama as a provider and remove any external API keys — all inference stays on your VPS. LiteLLM adds routing, load balancing and the dashboard on top of your local Ollama without any outbound connection requirement.",{"ram":78,"cpu":79,"stack":80,"port":84},"1 GB (2 GB recommended)","2 vCPU",[81,82,83],"Docker","Python","PostgreSQL 16","4000",[86],"ubuntu-24.04",[88,96,102],{"name":89,"slug":90,"categorySlug":11,"categoryName":91,"categoryColor":92,"logo":93,"tagline":94,"description":95},"Ollama","ollama","Artificial Intelligence","text-purple-400 bg-purple-500\u002F10","https:\u002F\u002Fcdn.simpleicons.org\u002Follama","Run open-source LLMs on your VPS — OpenAI-compatible API, zero per-token cost.","Run open-source LLMs locally via a dead-simple API. Pull Llama 3, Mistral, Qwen or DeepSeek in one command — OpenAI-compatible, zero per-token cost.",{"name":97,"slug":98,"categorySlug":11,"categoryName":91,"categoryColor":92,"logo":99,"tagline":100,"description":101},"Open WebUI","open-webui","https:\u002F\u002Fcdn.jsdelivr.net\u002Fgh\u002Fselfhst\u002Ficons\u002Fsvg\u002Fopen-webui.svg","Web interface for your LLMs — Ollama, OpenAI, Mistral — hosted on your own server.","Web interface to interact with your local or remote LLMs. Your data stays on your infrastructure — no third party involved.",{"name":103,"slug":103,"categorySlug":104,"categoryName":105,"categoryColor":106,"logo":107,"tagline":108,"description":109},"n8n","automation-workflows","Automation & Workflows","text-brand-action bg-brand-action\u002F10","https:\u002F\u002Fcdn.simpleicons.org\u002Fn8n","Automate your business processes with 400+ integrations — 100% self-hosted on your VPS.","Automate your workflows across applications without code. Over 400 integrations, 100% self-hosted on your VPS.",[111,112,113],"self-host-litellm-vps","heberger-ollama-vps","deployer-dify-vps",{"key":10,"slug":11,"name":91,"objective":115,"icon":116,"color":92},"Build, host and run AI solutions.","ai",1787661757786]