[{"data":1,"prerenderedAt":89},["ShallowReactive",2],{"seo-verification":3,"marketplace-app-en-langfuse":6},{"google":4,"bing":5},"EycwPY2XMyTkVzas3n1ygeNJFGAH513qrMjfDljzsMQ","",{"slug":7,"name":8,"description":9,"phase":10,"docsUrl":11,"logo":12,"github":13,"tagline":14,"longDescription":15,"features":16,"useCases":24,"steps":34,"faq":53,"specs":69,"compatibleOs":80,"relatedApps":81,"relatedPosts":82,"category":83},"langfuse","Langfuse","Open-source LLM observability: trace every AI request, run evaluations, manage prompt versions and compare model costs — self-hosted, compatible with OpenAI, LiteLLM, LangChain and Ollama.",1,"https:\u002F\u002Fservorbit.com\u002Fblog\u002Fself-host-langfuse-vps","https:\u002F\u002Fcdn.jsdelivr.net\u002Fgh\u002Fselfhst\u002Ficons\u002Fsvg\u002Flangfuse.svg","https:\u002F\u002Fgithub.com\u002Flangfuse\u002Flangfuse","Trace, evaluate and manage your LLM applications — self-hosted, production-ready.","Langfuse is the leading open-source LLM observability platform. It gives you deep visibility into every AI request your application makes: full prompt and completion traces, latency breakdowns, cost tracking per model and per user, and structured evaluation scores — all in a single dashboard.\n\nDeployed on your VPS, Langfuse replaces cloud-hosted alternatives (Langsmith, Helicone, Arize) without sending your traces or user data to third parties. A single SDK call (`@observe()` decorator or `langfuse.trace()`) instruments any Python, TypeScript, or OpenAI-compatible stack in minutes — LiteLLM, LangChain, LlamaIndex, Dify, and direct API calls all emit traces automatically.\n\nVersion 3.x (MIT core) adds a prompt management hub where engineers can A\u002FB-test prompt versions, run evaluations with LLM-as-a-judge or human raters, and promote the winning prompt to production without a code deploy. A REST API, a web SDK and native integrations make it the operational backbone for any team shipping AI to users.",[17,18,19,20,21,22,23],"Full-stack LLM tracing: prompt, completion, latency, cost and token count per call — nested spans for agent chains","Native SDK for Python and TypeScript, plus automatic integration with LiteLLM, LangChain, LlamaIndex, and Dify","Prompt management: version-control your prompts, A\u002FB test variants, push updates without code deploys","Evaluation framework: run LLM-as-a-judge, human annotation, or model-based scoring against any trace","Cost and usage analytics: breakdown by model, endpoint, user and session — compare providers at a glance","Dataset management: capture production traces as golden test sets for offline evaluation","Role-based access control: scoped API keys per environment (dev, staging, prod)",[25,28,31],{"title":26,"body":27},"Debug LLM regressions","When a new model or prompt version degrades quality, filter traces by evaluation score, compare side-by-side with the previous version, and reproduce the failing input in one click.",{"title":29,"body":30},"Monitor production AI costs","Track token spend by model, user and feature — set alerts when a single endpoint exceeds your budget. Switch from GPT-4 to a cheaper model using data, not guesswork.",{"title":32,"body":33},"Iterate on prompts without deploys","Push a prompt update from the Langfuse UI, route a percentage of traffic to the new version, collect evaluation scores, and promote the winner — all without touching your application code.",[35,38,41,44,47,50],{"title":36,"body":37},"Order a ServOrbit VPS (4 GB RAM minimum)","Langfuse runs PostgreSQL, ClickHouse, Redis and MinIO alongside the web and worker services. A 4 GB plan is the practical minimum; 8 GB is recommended for production workloads.",{"title":39,"body":40},"One-click install","Select Langfuse in the ServOrbit marketplace and click Deploy. Docker Compose brings up all six services automatically. The web UI is available on your domain once all health checks pass (allow 60–90 seconds on first boot for ClickHouse initialisation).",{"title":42,"body":43},"Create your first project","Open `https:\u002F\u002Fyour-domain.com` and register (signup is enabled by default). Create a project and copy its public\u002Fsecret key pair from the Settings page.",{"title":45,"body":46},"Instrument your application","In Python: `pip install langfuse`, set `LANGFUSE_HOST=https:\u002F\u002Fyour-domain.com`, `LANGFUSE_PUBLIC_KEY` and `LANGFUSE_SECRET_KEY`, then decorate your LLM calls with `@observe()`. In TypeScript: `npm install langfuse`, initialise with your host and keys. Traces appear in the dashboard within seconds.",{"title":48,"body":49},"Enable automatic tracing (LiteLLM)","If you already have LiteLLM in your stack: add `success_callback = [\"langfuse\"]` to your `litellm_config.yaml` and set the three env vars above. Every proxied LLM call is traced automatically — no application-level code change needed.",{"title":51,"body":52},"Run your first evaluation","Go to Traces, select a representative set, click 'Add to dataset'. Open Evaluations, create a score template (e.g. 1-5 relevance), attach it to the dataset, and run a batch evaluation with LLM-as-a-judge or your own scoring function.",[54,57,60,63,66],{"q":55,"a":56},"What is Langfuse?","Langfuse is an open-source LLM observability and prompt management platform. It records every prompt sent to a language model and every completion received, then lets you analyse quality, cost, latency and regressions — all on infrastructure you control.",{"q":58,"a":59},"How much RAM does Langfuse need?","Langfuse runs six services: the web frontend, a background worker, PostgreSQL, ClickHouse, Redis and MinIO. Minimum is 4 GB RAM; 8 GB is recommended for steady production traffic. ClickHouse is the heaviest component (~1–2 GB at load).",{"q":61,"a":62},"Is Langfuse free to self-host?","Yes. The Langfuse core (MIT licence) is completely free. The optional Langfuse Cloud SaaS (langfuse.com) has a free tier and paid plans. On ServOrbit, you only pay for the VPS — Langfuse itself costs nothing.",{"q":64,"a":65},"Which LLM providers does Langfuse support?","Langfuse is provider-agnostic. Native integrations exist for OpenAI, Anthropic, Azure OpenAI, Cohere, and any OpenAI-compatible API (Ollama, LiteLLM, Mistral, Groq…). LangChain, LlamaIndex, Dify, Haystack, and VercelAI also have first-class integrations.",{"q":67,"a":68},"Does Langfuse require a domain?","Yes. Langfuse uses NextAuth.js for authentication, which requires a publicly resolvable domain (HTTPS) to set the correct callback URL and session cookies. A subdomain on any domain you own is sufficient.",{"ram":70,"cpu":71,"stack":72,"port":79},"4 GB (8 GB recommended for production)","2 vCPU",[73,74,75,76,77,78],"Docker","Next.js","PostgreSQL 16","ClickHouse 24","Redis 7","MinIO","3000",[],[],[],{"key":84,"slug":84,"name":85,"objective":86,"icon":87,"color":88},"ia","Artificial Intelligence","Build, host and run AI solutions.","ai","text-purple-400 bg-purple-500\u002F10",1785714046304]