---
title: "Deploy AnyCrawl"
description: "Self-hosted scrape/crawl/SERP API that turns sites into LLM-ready data."
category: "AI/ML"
url: https://railway.com/deploy/anycrawl
---

# Deploy AnyCrawl

Self-hosted scrape/crawl/SERP API that turns sites into LLM-ready data.

**[Deploy AnyCrawl on Railway](https://railway.com/template/anycrawl)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/anycrawl/manifest.json

- **Creator:** Youssef Siam
- **Category:** AI/ML

## Template content

### scrape-playwright

- **Image:** ghcr.io/any4ai/anycrawl-scrape-playwright:v1.0.0

### redis

- **Image:** redis:7-alpine
- **Start command:** `redis-server --appendonly yes --protected-mode no`

### postgres

- **Image:** postgres:16-alpine

### scrape-cheerio

- **Image:** ghcr.io/any4ai/anycrawl-scrape-cheerio:v1.0.0

### api

- **Image:** ghcr.io/youssefsiam38/anycrawl-railway:1.0.0
- **Health check:** /health
- **Public domain:** Yes

## Documentation

# Deploy and Host AnyCrawl on Railway

AnyCrawl is an open-source, self-hosted scrape / crawl / SERP API that turns websites into LLM-ready data and
extracts structured search results — a MIT-licensed alternative to hosted crawling APIs. This template deploys
AnyCrawl with API-key authentication on and a working key generated for you. It is a community-maintained template
and is not affiliated with the AnyCrawl project.

## About Hosting AnyCrawl

AnyCrawl is a small microservice set: an HTTP API plus per-engine scrape workers that communicate through Redis (a
job queue) and PostgreSQL (state and results). It requires API-key authentication — keys are database rows, and
exposing the API without a key on a public URL would let anyone crawl the web on your bill.

This template runs AnyCrawl on Railway with a bundled private PostgreSQL and Redis, a static-HTML (cheerio) worker
and a JavaScript-rendering (playwright) worker, and it generates an API key and seeds it into the database at
start-up — so you get a known, working key from the service's variables instead of one printed to the logs. Only
the API is public; the workers, database and cache stay on the private network. Every image is official and pinned
by digest.

## Common Use Cases

- Feeding clean, LLM-ready markdown from web pages into RAG pipelines and agents.
- Scraping JavaScript-rendered pages (via the playwright engine) that a plain HTTP fetch cannot read.
- Running a private, self-hosted crawling/SERP API where the data and the key stay in your own infrastructure.

## Dependencies for AnyCrawl Hosting

- Nothing external — PostgreSQL and Redis are bundled, and the scrape workers run in the same project.

### Deployment Dependencies

- AnyCrawl: https://github.com/any4ai/AnyCrawl (MIT)
- PostgreSQL and Redis (official Docker images)
- Template repository, image and tests: https://github.com/youssefsiam38/anycrawl-railway

### Implementation Details

The API runs upstream's official image, pinned by digest, with a start-up wrapper that seeds the API key from the
generated `ANYCRAWL_API_KEY` (using AnyCrawl's own database layer, idempotently, without printing it). The API
enqueues scrape jobs on Redis; the cheerio worker (static HTML) and the playwright worker (JavaScript-rendered
pages) consume them and write results to PostgreSQL, which the API returns — so no shared filesystem is needed
between services. Redis is bound on `::` for Railway's IPv6 private network, only the API has a public domain, and
the port and health check are wired.

Tested in CI and on a live deployment of this template: the API is healthy, a request with no key or a wrong key is
rejected, the seeded key works, and a scrape returns LLM-ready markdown for both the cheerio and playwright engines;
the key and data survive a redeploy.

After deploying, copy `ANYCRAWL_API_KEY` from the api service's variables and call
`POST https:///v1/scrape` with `Authorization: Bearer ` and a JSON body
`{"url":"…","engine":"cheerio"}` (or `"playwright"` for JavaScript pages).

## Why Deploy AnyCrawl on Railway?

Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you
don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying AnyCrawl on Railway, you are one step closer to supporting a complete full-stack application with
minimal burden. Host your servers, databases, AI agents, and more on Railway.


## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [stella](https://railway.com/deploy/stella) — Self-host stella with web, API, Postgres, Redis, and object storage.
- [Hermes Agent | OpenClaw Alternative with Dashboard](https://railway.com/deploy/hermes-agent-or-openclaw-alternative-wit) — Self-Hosted Hermes AI Agent for Telegram, Discord & Slack

Open this page in a browser: https://railway.com/deploy/anycrawl