Deploy SillyTavern OpenRouter

Chat with hundreds of OpenRouter models in SillyTavern

Deploy SillyTavern OpenRouter

Just deployed

/home/node/app/data

Deploy and Host self hosted SillyTavern OpenRouter (Self-Hosted SillyTavern on OpenRouter Models) on Railway

This template runs a private SillyTavern that connects to OpenRouter with one key, reaching Claude, GPT, Gemini, DeepSeek and open roleplay models.

About Hosting SillyTavern OpenRouter open-source software on Railway (self hosted SillyTavern with OpenRouter models template)

Your characters, chats, personas, lorebooks and the OpenRouter key you paste into the plug icon all live on one Railway volume mounted at /home/node/app/data, so the data stays yours even though the server runs on Railway.

Why Deploy SillyTavern OpenRouter, the Character.AI alternative on Railway (Railway Free Trial)

Character.AI hosts the characters and the models, so you get its filters and its catalog and nothing else.

Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying SillyTavern OpenRouter on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.

Railway vs Other Hosting Providers and VPS for SillyTavern OpenRouter self hosting

Here is how Railway compares with renting a server yourself.

ProviderWhat You Get with RailwayWhat You Get with the Other Provider
DigitalOceanA one-click template with the volume, health check, and admin password set up, plus HTTPS.A Linux droplet you run yourself, including Docker, proxy, firewall, and backups.
AWSOne service with no VPC, IAM, or security groups to set up first.Many regions and knobs, with a steeper learning curve and harder-to-predict billing.
HetznerManaged deploys, auto-restart, and the data volume handled for you.Cheap hardware, but patching, uptime, and TLS are all on you.

Pick Railway if you want OpenRouter on your phone without becoming a sysadmin.

Common Use Cases for hosted SillyTavern OpenRouter

  • One key for many models: Paste one OpenRouter key and switch between Claude, GPT, Gemini and DeepSeek from the model list. Your characters and chats stay put while the model changes.
  • Trying new models on the same character: Keep one character card and one chat history, then rerun a scene on a different model to compare tone and pacing. It's the quickest way to find which model suits a character you care about.
  • Free models for light use: Some OpenRouter models are free with a daily request limit, enough for casual roleplay. Buying a small amount of credits once raises that daily cap.
  • A private server on phone and laptop: Because SillyTavern runs on Railway, you can pick up the same chats from your phone or your desk. Your data lives on the server volume, not on one device.
  • Per-user keys for a small group: Create accounts for friends or family so each person pastes their own key and keeps their own chats. Each key carries its own credit limit, so one heavy user won't drain everyone else's budget.

Dependencies for SillyTavern OpenRouter Docker hosted on Railway

This template runs as one service on the official SillyTavern image, so your only real dependency is an OpenRouter API key.

Deployment Dependencies for Managed SillyTavern OpenRouter Service (LLM Chat Frontend)

  • Image: ghcr.io/sillytavern/sillytavern:1.19.0, pinned by tag and digest.
  • Port: 8000, with PORT and SILLYTAVERN_PORT kept equal.
  • Volume: mounted at /home/node/app/data, holding chats, presets and API keys.
  • Health check: /login, restart policy ALWAYS.
  • Variables: ADMIN_PASSWORD (generated), SILLYTAVERN_LISTEN=true, SILLYTAVERN_ENABLEUSERACCOUNTS=true, PUID=1000, PGID=1000.

Implementation Details for SillyTavern OpenRouter (Using SillyTavern official docker image)

The start command handles the fiddly parts. It drops privileges to node, so the container never runs as root.

Logins are limited to 5 attempts a minute per client IP, and every API route needs a session. Expect about 150 MB at idle.

How does SillyTavern OpenRouter compare against other ways to reach many models from SillyTavern

SillyTavern vs Character.AI (Character.AI Alternative)

  • Model choice: Character.AI runs its own hosted models with no bring-your-own option. SillyTavern lets you pick any OpenRouter model per chat.
  • Where chats live: Character.AI keeps your chats on its servers. Here, characters, chats and the API key sit on your own Railway volume.
  • Where Character.AI wins: It needs zero setup and no key to manage, so it's the easier path if you don't care which model answers.

SillyTavern vs Open WebUI (Open WebUI Alternative)

  • Focus: Open WebUI is a general ChatGPT-style interface with strong Ollama and RAG features. SillyTavern is built around character cards, group chats and lorebooks.
  • Model source: Open WebUI shines with local models through Ollama. This setup points at OpenRouter's hosted catalog.
  • Where Open WebUI wins: For document chat and a general assistant, its RAG tooling is more complete.

SillyTavern vs Agnai (Agnai Alternative)

  • Purpose: Agnai is an open-source multi-user roleplay chat. SillyTavern is single-user-first, though you can add a few accounts that each keep their own characters and keys.
  • Depth of tuning: SillyTavern exposes prompt post-processing, context size and preset control per model, which suits people who like to tune a scene.
  • Where Agnai wins: Its group-first design is simpler for a shared roleplay community.

OpenRouter vs direct provider keys (Direct API Keys Alternative)

  • One key, many models: OpenRouter gives one endpoint and a shared credit pool for Claude, GPT, Gemini, DeepSeek and open models, so you swap models without swapping keys.
  • Limits and billing: You set a credit limit on the key and see cost per message in one place.
  • Where direct keys win: For one model you use constantly, a direct key can be cheaper, and you get that vendor's newest features first.

How to use SillyTavern OpenRouter (the OSS LLM chat frontend)?

Here is the first-day sequence once your deploy is healthy.

  1. Open the public URL and log in as default-user with the ADMIN_PASSWORD value from the Variables tab.
  2. In OpenRouter, create an API key and set a credit limit on it so a runaway chat cannot drain your balance.
  3. Click the plug icon to open API Connections.
  4. Choose Chat Completion, then pick OpenRouter as the source. Text Completion works too, but Chat Completion gives you the chat-style features most people want.
  5. Paste the key and connect. SillyTavern saves it to the secrets file on your data volume, scoped to your user.
  6. Pick a model from the list. Free models have daily request limits, so start there to test the setup.
  7. Set context size and response length in the same panel, then send your first message.
Plug icon > API Connections > Chat Completion > OpenRouter > key > Connect
Model, context size, and response length live in the connection panel.

How to self host SillyTavern OpenRouter on other VPS Services (SillyTavern self hosting guide)

Clone the Repository

Start on any Linux box you control. Clone upstream SillyTavern and check out a tagged release.

git clone https://github.com/SillyTavern/SillyTavern.git
cd SillyTavern
git checkout 1.19.0

Install Dependencies

SillyTavern needs Node.js.

npm install --no-audit --no-fund

Configure Environment Variables

Before you expose the server, edit config.yaml.

listen: true
whitelistMode: false
enableUserAccounts: true

Put TLS in front of it with Caddy or nginx and point your-domain at the server. Never expose port 8000 bare.

Start the SillyTavern OpenRouter Application

Run the start script, open your-domain, log in, click the plug icon, choose OpenRouter and paste your key.

./start.sh

Railway handles TLS, process supervision, the persistent volume and restarts for you.

Official Pricing of SillyTavern OpenRouter (SillyTavern pricing)

SillyTavern is free and open source under AGPL-3.0, so there is no license fee to pay. You pay two things instead.

SillyTavern OpenRouter cloud vs self hosted comparison (Pricing, features, costs, and more)

Hosted chat sites are the easy way in, but they lock you to their models and their limits. The trade is that you own the uptime and the setup.

Monthly cost of self hosting SillyTavern OpenRouter on Railway

On Railway, one always-on SillyTavern instance at light use typically lands around $5 a month, since the app idles near 150 MB of memory.

System Requirements for Hosting SillyTavern OpenRouter on a VPS

Plan for roughly 150 MB of RAM at idle and room for peaks near 500 MB during the first-boot frontend compile.

Frequently Asked Questions (FAQs)

Should I pick Chat Completion or Text Completion?

Use Chat Completion for most chats, since it sends the conversation as a message list that chat models expect.

Are the free models really free?

Some models are free with a daily request limit, and buying at least 10 USD of credits once raises that cap.

Where is my OpenRouter key stored?

SillyTavern saves it in the secrets file on your Railway data volume, with a separate copy for each user. It never appears on the template page or in the image.

How much does one message cost?

It depends on the model and how much context you send, so long chats with a large context size cost more per reply.

A model I want is missing from the list. What now?

Search the model list in the API Connections panel by name, since OpenRouter adds models often.

Can I share this server with friends?

Yes, as admin you can create accounts for friends in the Admin Panel.


Template Content

More templates in this category

View Template
Chat Chat
Chat Chat, your own unified chat and search to AI platform.

okisdev
117
View Template
NEW
Weaviate
Vector database with hybrid search and an API key-protected API

zer0person
1
View Template
NEW
Möbius v0.1 Personal AI OS
Self-hosted AI agent that builds and runs apps for you, with memory.

bento
1