---
title: "Deploy Promptfoo evaluation"
description: "Private Promptfoo evaluation and red teaming with persistent project data."
category: "AI/ML"
url: https://railway.com/deploy/promptfoo-evaluation
---

# Deploy Promptfoo evaluation

Private Promptfoo evaluation and red teaming with persistent project data.

**[Deploy Promptfoo evaluation on Railway](https://railway.com/template/promptfoo-evaluation)**

- **Creator:** Anton Orel's Projects
- **Category:** AI/ML
- **Total deploys:** 2

## Template content

### Promptfoo Gateway

- **Image:** caddy:2.10-alpine@sha256:4c6e91c6ed0e2fa03efd5b44747b625fec79bc9cd06ac5235a779726618e530d
- **Start command:** `/bin/sh -ec 'password_hash="$(caddy hash-password --plaintext "$PROMPTFOO_PASSWORD")"; printf '"'"':8080 {\n handle /healthz {\n  respond "ok" 200\n }\n handle {\n  basic_auth {\n   %s %s\n  }\n  reverse_proxy %s\n }\n}\n'"'"' "$PROMPTFOO_USERNAME" "$password_hash" "$PROMPTFOO_UPSTREAM" >/tmp/Caddyfile; exec caddy run --config /tmp/Caddyfile --adapter caddyfile'`
- **Health check:** /healthz
- **Public domain:** Yes

### Promptfoo

- **Source:** tech-progress/railway-template-promptfoo
- **Health check:** /health

## Documentation

# Deploy and Host Promptfoo on Railway

Deploy Promptfoo's LLM evaluation and red-team UI behind an authenticated gateway with persistent local results.

## About Hosting Promptfoo

Promptfoo is an MIT-licensed toolkit for testing prompts, models, agents, and security behavior. This template runs its community self-hosted UI and API as a private service while Caddy provides generated Basic Auth at the public edge.

## Why Deploy Promptfoo on Railway

Railway supplies private networking, a persistent 5 GB volume, generated gateway credentials, and health-checked services in one deployment. Telemetry, update checks, remote generation, and hosted result sharing are disabled by default, so evaluation data stays with the deployment unless a configured model provider receives it.

## Common Use Cases

- Compare prompts and model providers with repeatable test cases.
- Review evaluation results in a shared, authenticated UI.
- Run red-team experiments against development AI systems.

## Dependencies for Promptfoo Hosting

### Deployment Dependencies

The template includes Promptfoo `0.117.2`, Caddy `2.10`, and a 5 GB persistent volume. Add provider API keys to the private `Promptfoo` service when required.

After deployment, open `Promptfoo Gateway` and use its generated username and password. The community server uses SQLite, supports one replica, has in-memory jobs, and does not include built-in SSO or supported scheduling, so this template is intended for individual and experimental deployments.


## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [stella](https://railway.com/deploy/stella) — Self-host stella with web, API, Postgres, Redis, and object storage.
- [Hermes Agent | OpenClaw Alternative with Dashboard](https://railway.com/deploy/hermes-agent-or-openclaw-alternative-wit) — Self-Hosted Hermes AI Agent for Telegram, Discord & Slack

Open this page in a browser: https://railway.com/deploy/promptfoo-evaluation