Deploy websurfer
An API designed to help LLMs surf the web.
Redis
Just deployed
/data
websurfer
Just deployed
Deploy and Host WebSurfer on Railway
WebSurfer is a high-performance API that helps LLMs surf the web. It fetches, parses, and converts web content (HTML, PDF, Markdown) into LLM-friendly formats with token estimation, pagination, and Redis-backed caching.
About Hosting WebSurfer
WebSurfer deploys as a single Go binary with Redis as its only dependency. The server handles web fetching, content parsing, and caching automatically. Configuration is managed through environment variables for connection settings and an optional config.yaml for fine-tuning behavior like rate limits, user agents, and site-specific rules. The API requires authentication via API key for all endpoints except the health check.
Common Use Cases
- Powering AI agents that need to read and understand web pages
- Building RAG pipelines that ingest web content
- Creating web research tools for LLM applications
Dependencies for WebSurfer Hosting
- Go runtime (included in Railway build)
- Redis (for caching)
Deployment Dependencies
- Redis - Required for caching fetched content
Why Deploy WebSurfer on Railway?
Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.
By deploying WebSurfer on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.
Template Content
Redis
redis:8.2.1websurfer
ghcr.io/joeychilson/websurfer:latest
