How do I deploy SillyTavern on Railway?

You can deploy SillyTavern on Railway by clicking the "Deploy Now" button on this page. Railway will automatically set up all the necessary services and configurations for you.

What are the system requirements?

Railway handles all the infrastructure requirements. You only need a web browser to deploy and manage your application.

Is this template free to use?

Yes, this template is free to use within your existing Railway account.

Can I customize this template?

Yes, you can fully customize this template. After deployment, you will have full control of what you've deployed in your Railway project.

How do I get support for this template?

You can get support through our community forum: silly-tavern-ac69f720, or click "Get template help" for this template for more assistance.

Deploy and Host SillyTavern on Railway

⚠️
After deploying, it may take a couple minutes for it to be ready, check Deploy Logs to see if it's ready.
I also highly recommend you to change the password of default user to something else as soon as you're able to access ST.

SillyTavern (or ST for short) is a locally installed user interface that allows you to interact with text generation LLMs, image generation engines, and TTS voice models. Our goal is to empower users with as much utility and control over their LLM prompts as possible, embracing the steep learning curve as part of the fun.

SillyTavern is a passion project brought to you by a dedicated community of LLM enthusiasts and will always be free and open-sourced. Beginning in February 2023 as a fork of TavernAI 1.2.8, SillyTavern now has over 200 contributors and 2 years of independent development under its belt, and continues to serve as a leading software for savvy AI hobbyists.

About Hosting SillyTavern

This template pretty much uses the original SillyTavern's Docker image but slightly modified so that the config can be managed by Environment Variable .

Common Use Cases

Roleplay
AI Assistant/Chatbot with advanced QoL features

Key Features

Advanced text generation settings with many community-made presets
World Info support: create rich lore or save tokens on your character card
Group chats: multi-bot rooms for characters to talk to you and/or each other
Rich UI customization options: theme colors, background images, custom CSS, and more
User personas: let the AI know a bit about you for greater immersion
Built-in RAG support: add documents to your chats for the AI to reference
Extensive chat commands subsystem and own scripting engine

Dependencies for SillyTavern Hosting

Nothing, but it takes a couple of minutes for it to be ready/accessible, you can check the Deploy Logs to see if it is ready or not.

VERY IMPORTANT: Default user doesn't have a password by default, so it highly recommended for you to change it as soon as you're able to access ST.

Deployment Dependencies

Implementation Details

This template uses the latest version of SillyTavern but older versions are archived in case you need it, you can check out this link to see which versions are available (default to latest which uses ST v1.15.0 as of the time of writing).

Configurations

Environment Variable	Description	Default
`SILLYTAVERN_DISCREET_LOGIN`	Toggle user list, can be `true` or `false`	`false`
`SILLYTAVERN_LOG_LEVEL`	Set ST log level, can be a number from `0` to `3` (DEBUG = 0, INFO = 1, WARN = 2, ERROR = 3)	`3`
`SILLYTAVERN_ENABLE_IPV6`	Enable IPv6 support, can be `true` or `false`	`false`
`SILLYTAVERN_PREFER_IPV6`	Prefer IPv6 connection, can be `true` or `false`	`false`
`SILLYTAVERN_GEMINI_API_VERSION`	Gemini API entrypoint version (new in v1.13.0)	`v1beta`

Why Deploy SillyTavern on Railway?

Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying SillyTavern on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.