Deploy and Host Agent Regression Diff on Railway

Compare expected and observed agent outputs by case ID.

About Hosting Agent Regression Diff

This is a stateless JSON tool. Deploy it, copy TOOL_TOKEN from service variables and send it as an Authorization: Bearer header on POST /run. The /health endpoint is public and returns readiness only. Inputs are limited to 64 KiB. The application does not store requests or call a model.

Why Deploy Agent Regression Diff

Call a deterministic operation from an agent, workflow or application without an LLM API key.

Common Use Cases

Compare expected and observed agent outputs by case ID.
Insert a deterministic check or transformation in a workflow.
Repeat the documented example in a regression check.

Dependencies for Agent Regression Diff

Python 3.13 container and a Railway project.
An HTTP client with your generated bearer token.

Example input for POST /run

{"expected": {"a": 1, "b": 2}, "actual": {"a": 1, "b": 3}}

Expected response

{"result": ["b"]}

The single process is intended for small internal workloads. Set concurrency and load limits upstream before serving high volume traffic.