[{"data":1,"prerenderedAt":110},["ShallowReactive",2],{"seo-verification":3,"marketplace-app-fr-local-ai":6},{"google":4,"bing":5},"EycwPY2XMyTkVzas3n1ygeNJFGAH513qrMjfDljzsMQ","",{"slug":7,"name":8,"description":9,"phase":10,"docsUrl":11,"logo":12,"github":13,"tagline":14,"longDescription":15,"features":16,"useCases":24,"steps":34,"faq":53,"specs":72,"compatibleOs":80,"relatedApps":81,"relatedPosts":103,"category":107},"local-ai","LocalAI","Run open-source LLMs on CPU — no GPU required. Drop-in OpenAI-compatible API, 200+ models (Llama, Mistral, Phi), fully self-hosted on your VPS.",1,"https:\u002F\u002Fservorbit.com\u002Fblog\u002Fself-host-localai-vps","https:\u002F\u002Fraw.githubusercontent.com\u002Fmudler\u002FLocalAI\u002Fmaster\u002Fcore\u002Fhttp\u002Fstatic\u002Flogo.png","https:\u002F\u002Fgithub.com\u002Fmudler\u002FLocalAI","Run open-source LLMs on CPU — no GPU required. OpenAI-compatible API, 200+ models, self-hosted in one command.","LocalAI (MIT, ~47k GitHub stars) is a free, open-source alternative to the OpenAI API. It runs on consumer-grade hardware without a GPU — any VPS with 2 GB RAM can serve Llama 3, Mistral, Phi-3, Qwen and 200+ other models via an OpenAI-compatible REST API. Your existing code that calls `openai.ChatCompletion.create()` works without modification: change the base URL to your VPS and all API calls are routed locally, with zero per-token cost and complete data privacy.\n\nDeployed on a ServOrbit VPS, LocalAI becomes your private LLM backend: an endpoint your team's applications, RAG pipelines and agent frameworks call instead of OpenAI — with no cloud dependency, no usage limits, and no data leaving your infrastructure. LocalAI supports text generation, function calling, image generation (Stable Diffusion), speech-to-text (Whisper), and text embeddings — all from a single container.",[17,18,19,20,21,22,23],"OpenAI-compatible REST API — drop-in replacement for OpenAI, works with every LangChain\u002FLlamaIndex\u002FLiteLLM SDK unchanged.","CPU-only inference — runs on any VPS without a GPU using llama.cpp; optimised SIMD paths for Intel and ARM.","200+ models supported — Llama 3, Mistral, Phi-3, Qwen 2.5, DeepSeek, Gemma 2, Falcon, and any GGUF-format model.","Multi-modal: text generation, function\u002Ftool calling, embeddings, image generation (Stable Diffusion), and speech-to-text (Whisper).","Pull models by name — `curl http:\u002F\u002Flocalhost:8080\u002Fmodels\u002Fapply -d '{\"id\":\"llama-3.2-3b-instruct:q4_0\"}'` downloads and activates any supported model.","MIT licence — fully auditable, no telemetry, air-gap capable; v4.6.2 (released 2026-07-06) adds distributed cluster mode and prefix-cache-aware routing.","Composable with LiteLLM and Open WebUI — LocalAI serves the inference layer; LiteLLM adds multi-provider routing; Open WebUI adds the chat UI.",[25,28,31],{"title":26,"body":27},"Private LLM backend for your applications","Replace your OpenAI API calls with a LocalAI endpoint on your VPS. Your SaaS, internal tool, or RAG pipeline sends requests to `http:\u002F\u002Fyour-vps:8080\u002Fv1\u002Fchat\u002Fcompletions` — identical JSON, identical SDK, zero cost per token. Ideal for high-volume use cases where per-token API pricing becomes a bottleneck.",{"title":29,"body":30},"Air-gapped inference for sensitive data","For legal, medical or financial applications where data cannot leave your infrastructure, LocalAI runs entirely offline once the model is downloaded. No requests ever reach an external API. The GGUF model files are stored in a Docker volume on your own disk.",{"title":32,"body":33},"Embeddings and semantic search without an API key","Run embedding models (nomic-embed-text, mxbai-embed-large) locally alongside Qdrant on the same VPS to build a complete semantic search or RAG pipeline. No OpenAI embedding API cost, no data leaving your server, no rate limits.",[35,38,41,44,47,50],{"title":36,"body":37},"Create the VPS","Order a VPS on ServOrbit with at least 2 GB RAM and Ubuntu 22.04 or 24.04. For comfortable multi-user usage or larger models (7B+), 4 GB RAM is recommended. CPU count matters for inference speed: 4 vCPU reduces generation latency noticeably on 3–7B models.",{"title":39,"body":40},"Deploy LocalAI","Connect via SSH and run: `docker run -d --restart=always -p 8080:8080 -v local-ai:\u002Fbuild\u002Fmodels --name localai localai\u002Flocalai:latest`. The image (about 900 MB) starts an OpenAI-compatible API server. The first request for a model triggers an automatic download to the persistent volume.",{"title":42,"body":43},"Pull a model","Download your first model with a single API call: `curl http:\u002F\u002Flocalhost:8080\u002Fmodels\u002Fapply -H 'Content-Type: application\u002Fjson' -d '{\"id\":\"llama-3.2-3b-instruct:q4_0\"}'`. LocalAI fetches the GGUF file and registers it. The 3B Q4 quantisation fits in 2 GB RAM; the 7B Q4 needs ~4 GB.",{"title":45,"body":46},"Make your first API call","Test the API: `curl http:\u002F\u002Flocalhost:8080\u002Fv1\u002Fchat\u002Fcompletions -H 'Content-Type: application\u002Fjson' -d '{\"model\":\"llama-3.2-3b-instruct:q4_0\",\"messages\":[{\"role\":\"user\",\"content\":\"Hello!\"}]}'`. The response is identical to OpenAI's — change the base URL in your existing code and everything works.",{"title":48,"body":49},"Point your apps at LocalAI","In any OpenAI SDK, set `base_url='http:\u002F\u002Fyour-vps-ip:8080\u002Fv1'` and `api_key='not-needed'`. In LangChain: `ChatOpenAI(base_url=..., api_key='x')`. In LiteLLM: add a `localai\u002F` prefix. In Open WebUI: configure an OpenAI connection with your VPS URL. Your existing code needs no other change.",{"title":51,"body":52},"Optional: protect the endpoint","LocalAI is open by default. To add authentication, set `LOCALAI_API_KEY=your-secret` environment variable when running the container. For HTTPS, place Caddy in front: `ai.yourdomain.com { reverse_proxy localhost:8080 }` — Caddy issues the Let's Encrypt cert automatically. Restrict port 8080 to your office IP using `ufw` if needed.",[54,57,60,63,66,69],{"q":55,"a":56},"What is LocalAI?","LocalAI is a free, open-source (MIT) server that runs large language models locally on any CPU. It exposes an OpenAI-compatible REST API, so your existing code works without modification — just change the API base URL to your server.",{"q":58,"a":59},"Do I need a GPU to run LocalAI?","No. LocalAI is built on llama.cpp, which runs efficiently on CPU using SIMD instructions (AVX2\u002FAVX-512 on Intel, NEON on ARM). A VPS with 2–4 GB RAM and 2–4 vCPU is enough for 3B–7B models. GPU acceleration is optional and supported if your server has a CUDA-compatible GPU.",{"q":61,"a":62},"Which models can I run?","LocalAI supports any model in GGUF format, which covers virtually all open-source LLMs: Llama 3.x, Mistral 0.7–7B, Phi-3\u002F3.5\u002F4 Mini, Qwen 2.5, DeepSeek-R1, Gemma 2, Falcon, and more. Pull a model with one API call — LocalAI downloads it from Hugging Face automatically.",{"q":64,"a":65},"How does LocalAI compare to Ollama?","Both run LLMs locally on CPU. LocalAI's advantage is its broader compatibility: it supports more model backends (not just llama.cpp), image generation, speech-to-text (Whisper), and embeddings from a single API. Ollama is simpler to set up and has a larger default model library. Both expose an OpenAI-compatible API.",{"q":67,"a":68},"Is my data private?","Yes. All inference happens on your VPS — no request is ever sent to an external API. The models are stored in a Docker volume on your own disk. LocalAI has no telemetry by default (MIT licence, fully auditable source code).",{"q":70,"a":71},"What are the RAM requirements?","A 3B model at Q4 quantisation needs roughly 2 GB RAM. A 7B model needs ~4 GB. A 13B model needs ~8 GB. For the smallest ServOrbit VPS plans (2 GB), the Phi-3 Mini (3.8B at Q4) runs well and delivers strong reasoning performance relative to its size.",{"ram":73,"cpu":74,"stack":75,"port":79},"2 GB (4 GB recommended for 7B+ models)","2 vCPU (4 vCPU recommended)",[76,77,78],"Docker","Go","llama.cpp","8080",[],[82,91,97],{"name":83,"slug":84,"categorySlug":85,"categoryName":86,"categoryColor":87,"logo":88,"tagline":89,"description":90},"Ollama","ollama","ia","Intelligence Artificielle","text-purple-400 bg-purple-500\u002F10","https:\u002F\u002Fcdn.simpleicons.org\u002Follama","Run open-source LLMs on your VPS — OpenAI-compatible API, zero per-token cost.","Run open-source LLMs locally via a dead-simple API. Pull Llama 3, Mistral, Qwen or DeepSeek in one command — OpenAI-compatible, zero per-token cost.",{"name":92,"slug":93,"categorySlug":85,"categoryName":86,"categoryColor":87,"logo":94,"tagline":95,"description":96},"LiteLLM","litellm","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F132372032","Self-hosted LLM API gateway — route between Ollama, Anthropic and 100+ providers from a single OpenAI-compatible endpoint.","Self-hosted OpenAI-compatible API gateway for 100+ LLMs — route between Ollama, Anthropic, Azure and more from a single endpoint, with per-key rate limits and spend tracking.",{"name":98,"slug":99,"categorySlug":85,"categoryName":86,"categoryColor":87,"logo":100,"tagline":101,"description":102},"Open WebUI","open-webui","https:\u002F\u002Fcdn.jsdelivr.net\u002Fgh\u002Fselfhst\u002Ficons\u002Fsvg\u002Fopen-webui.svg","Interface web pour vos LLMs — Ollama, OpenAI, Mistral — hébergée sur votre propre serveur.","Interface web pour interagir avec vos LLMs locaux ou distants. Vos données restent sur votre infrastructure — aucun tiers impliqué.",[104,105,106],"self-host-litellm-vps","heberger-ollama-vps","deployer-dify-vps",{"key":85,"slug":85,"name":86,"objective":108,"icon":109,"color":87},"Créer, héberger et exploiter des solutions IA.","ai",1785714045721]