langfuse v3 (AI Observability)

Open-source LLM platform for prompt management, tracing, evals & metrics

Deploy langfuse v3 (AI Observability)

clickhouse

clickhouse/clickhouse-server:24

Just deployed

/var/lib/clickhouse

postgres

railwayapp-templates/postgres-ssl:16

Just deployed

/var/lib/postgresql/data

redis

bitnami/redis:7.2.5

Just deployed

/bitnami

langfuse-web

langfuse/langfuse:3

Just deployed

minio

minio/minio

Just deployed

/data

langfuse-worker

langfuse/langfuse-worker:3

Just deployed

Langfuse is an open-source LLM engineering platform that helps teams collaboratively debug, analyze, and iterate on their LLM applications.

LLM Application Observability: Instrument your app and start ingesting traces to Langfuse, thereby tracking LLM calls and other relevant logic in your app such as retrieval, embedding, or agent actions. Inspect and debug complex logs and user sessions. Try the interactive demo to see this in action.

Prompt Management helps you centrally manage, version control, and collaboratively iterate on your prompts. Thanks to strong caching on server and client side, you can iterate on prompts without adding latency to your application.

Evaluations are key to the LLM application development workflow, and Langfuse adapts to your needs. It supports LLM-as-a-judge, user feedback collection, manual labeling, and custom evaluation pipelines via APIs/SDKs.

Datasets enable test sets and benchmarks for evaluating your LLM application. They support continuous improvement, pre-deployment testing, structured experiments, flexible evaluation, and seamless integration with frameworks like LangChain and LlamaIndex.

LLM Playground is a tool for testing and iterating on your prompts and model configurations, shortening the feedback loop and accelerating development. When you see a bad result in tracing, you can directly jump to the playground to iterate on it.

Comprehensive API: Langfuse is frequently used to power bespoke LLMOps workflows while using the building blocks provided by Langfuse via the API. OpenAPI spec, Postman collection, and typed SDKs for Python, JS/TS are available.


Template Content

More templates in this category

View Template

Chat Chat

Chat Chat, your own unified chat and search to AI platform.


View Template

openui

Deploy OpenUI: AI-powered UI generation with GitHub OAuth and OpenAI API.


View Template

firecrawl

firecrawl api server + worker without auth, works with dify