---
title: "Deploy Agent Document Dedup"
description: "Remove identical retrieved documents while keeping order"
category: "AI/ML"
url: https://railway.com/deploy/agent-document-dedup
---

# Deploy Agent Document Dedup

Remove identical retrieved documents while keeping order

**[Deploy Agent Document Dedup on Railway](https://railway.com/template/agent-document-dedup)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/agent-document-dedup/manifest.json

- **Creator:** dankeewithtwoes's Projects
- **Category:** AI/ML

## Template content

### Tool

- **Image:** python:3.13-slim
- **Start command:** `python -c "import base64,os;exec(compile(base64.b64decode(os.environ['TOOL_CODE']),'tool.py','exec'))"`
- **Health check:** /health
- **Public domain:** Yes

## Documentation

# Deploy and Host Agent Document Dedup on Railway

Remove identical retrieved documents while keeping order.

## About Hosting Agent Document Dedup

This is a stateless JSON tool. Deploy it, copy TOOL_TOKEN from service variables and send it as an Authorization: Bearer header on POST /run. The /health endpoint is public and returns readiness only. Inputs are limited to 64 KiB. The application does not store requests or call a model.

## Why Deploy Agent Document Dedup

Call a deterministic operation from an agent, workflow or application without an LLM API key.

## Common Use Cases

- Remove identical retrieved documents while keeping order.
- Insert a deterministic check or transformation in a workflow.
- Repeat the documented example in a regression check.

## Dependencies for Agent Document Dedup

- Python 3.13 container and a Railway project.
- An HTTP client with your generated bearer token.

### Example input for POST /run

```json
{"documents": ["a", "a", "b"]}
```

### Expected response

```json
{"result": ["a", "b"]}
```

The single process is intended for small internal workloads. Set concurrency and load limits upstream before serving high volume traffic.


## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [Weaviate](https://railway.com/deploy/weaviate-1) — Vector database with hybrid search and an API key-protected API
- [Möbius Personal AI OS](https://railway.com/deploy/mobius-v01-personal-ai-os) — Self-hosted AI agent that builds and runs apps for you, with memory.

Open this page in a browser: https://railway.com/deploy/agent-document-dedup