---
title: "Deploy FastAPIChat"
description: "A FastAPI App for benchmarking LLM models from various vendors."
category: "AI/ML"
url: https://railway.com/deploy/_-qAbG
---

# Deploy FastAPIChat

A FastAPI App for benchmarking LLM models from various vendors.

**[Deploy FastAPIChat on Railway](https://railway.com/template/_-qAbG)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/_-qAbG/manifest.json

- **Creator:** Mark Chen's Projects
- **Category:** AI/ML
- **Total deploys:** 17

## Template content

### Postgres https://devicons.railway.app/i/postgresql.svg

- **Image:** ghcr.io/railwayapp-templates/postgres-ssl:latest

### FastAPIChat

- **Image:** ghcr.io/yuting1214/fastapi-chat-ghcr:latest
- **Public domain:** Yes

## Documentation

## Overview

**FastAPIChat** is a modern, high-performance application for benchmarking LLM models from different vendors. Built with FastAPI and Python 3.9+, it leverages the power of FastAPI's asynchronous capabilities and provides an extensive system for collecting user feedback.

## Highlights

* Multi-LLM Benchmarking: Easily compare and evaluate the performance of LLM models from various vendors with different system prompts and temperature settings.
* Feedback Collection: Implement a robust feedback system to rate LLM outputs, enabling data collection for future fine-tuning and improvements.
* Streaming Responses: Integrated with FastAPI for real-time, non-blocking streaming responses, enhancing the user experience with immediate feedback.

## Learn More
* [Github](https://github.com/yuting1214/FastAPIChat)

## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [Weaviate](https://railway.com/deploy/weaviate-1) — Vector database with hybrid search and an API key-protected API
- [Möbius Personal AI OS](https://railway.com/deploy/mobius-v01-personal-ai-os) — Self-hosted AI agent that builds and runs apps for you, with memory.

Open this page in a browser: https://railway.com/deploy/_-qAbG