Deploy mystock-cralwer-project
An intelligent Product Crawler for MyStock
price_crawler Beat
Just deployed
price_crawler
Just deployed
laravel worker
Just deployed
Redis
Just deployed
/data
crawler_dashboard
Just deployed
Just deployed
/var/lib/postgresql/data
crawler_api
Just deployed
Deploy and Host mystock-cralwer-project on Railway
mystock-cralwer-project is a Laravel 12 + Filament v4 web dashboard that schedules and tracks competitor product-price scrapes. It manages products, competitors, brand strategies, scrape jobs and result logs through an admin UI, with queued workers and a per-minute scheduler for automated crawling.
About Hosting mystock-cralwer-project
Hosting mystock-cralwer-project means running three coordinated services from one codebase: a web container serving the Laravel/Filament app via PHP-FPM and Nginx, a worker container executing php artisan queue:work for scrape jobs, and a cron container looping schedule:run every minute. You also need a persistent database (MySQL or PostgreSQL) for the app's tables, sessions, cache and queue, plus env vars for APP_KEY, APP_URL, and DB credentials. Frontend assets are bundled with Vite during deploy and storage/config are cached for performance.
Common Use Cases
- Monitor competitor prices across multiple brands and products on a schedule
- Run one-off scrape jobs from the Filament admin panel via the queue
- Track scrape logs, errors and results for analysis and brand-strategy decisions
Dependencies for mystock-cralwer-project Hosting
- PHP 8.4 with ext-intl and ext-zip
- Composer & Node.js (for npm run build asset bundling)
- MySQL or PostgreSQL database
- A queue driver (database by default; Redis recommended for production)
Deployment Dependencies
- Laravel 12 deployment docs (https://laravel.com/docs/12.x/deployment)
- Filament v4 docs (https://filamentphp.com/docs/4.x)
- Nixpacks (Railway buildpack) (https://nixpacks.com/)
- Railway database docs (https://docs.railway.app/databases)
Implementation Details
[Include any code snippets or implementation details. This section is optional. Exclude if nothing to add.]
Why Deploy mystock-cralwer-project on Railway?
Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.
By deploying mystock-cralwer-project on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.
Template Content
price_crawler Beat
jawadashraf/price_crawlerUSE_PROXY
USE_PROXY
PROXY_URLS
PROXY_URLS
BROKER_TYPE
BROKER_TYPE
SERVICE_TYPE
SERVICE_TYPE
LARAVEL_API_URL
LARAVEL_API_URL
MAX_REQUEST_DELAY
MAX_REQUEST_DELAY
MIN_REQUEST_DELAY
MIN_REQUEST_DELAY
CELERY_CONCURRENCY
CELERY_CONCURRENCY
SCRAPE_TASK_TIMEOUT
SCRAPE_TASK_TIMEOUT
CONFIDENCE_THRESHOLD
CONFIDENCE_THRESHOLD
ENABLE_GOOGLE_FALLBACK
ENABLE_GOOGLE_FALLBACK
LARAVEL_WEBHOOK_SECRET
LARAVEL_WEBHOOK_SECRET
MAX_MATCHES_PER_PRODUCT
MAX_MATCHES_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
SCRAPE_TASK_SOFT_TIMEOUT
SCRAPE_TASK_SOFT_TIMEOUT
price_crawler
jawadashraf/price_crawlerUSE_PROXY
USE_PROXY
PROXY_URLS
PROXY_URLS
BROKER_TYPE
BROKER_TYPE
SERVICE_TYPE
SERVICE_TYPE
LARAVEL_API_URL
LARAVEL_API_URL
MAX_REQUEST_DELAY
MAX_REQUEST_DELAY
MIN_REQUEST_DELAY
MIN_REQUEST_DELAY
CELERY_CONCURRENCY
CELERY_CONCURRENCY
SCRAPE_TASK_TIMEOUT
SCRAPE_TASK_TIMEOUT
CONFIDENCE_THRESHOLD
CONFIDENCE_THRESHOLD
ENABLE_GOOGLE_FALLBACK
ENABLE_GOOGLE_FALLBACK
LARAVEL_WEBHOOK_SECRET
LARAVEL_WEBHOOK_SECRET
MAX_MATCHES_PER_PRODUCT
MAX_MATCHES_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
SCRAPE_TASK_SOFT_TIMEOUT
SCRAPE_TASK_SOFT_TIMEOUT
MATCHING_BRAND_PREFIX_STRIP_ENABLED
MATCHING_BRAND_PREFIX_STRIP_ENABLED
laravel worker
jawadashraf/crawler_dashboardAPP_ENV
APP_ENV
APP_KEY
APP_KEY
APP_URL
APP_URL
DB_HOST
DB_HOST
DB_PORT
DB_PORT
APP_NAME
APP_NAME
APP_DEBUG
APP_DEBUG
LOG_LEVEL
LOG_LEVEL
LOG_STACK
LOG_STACK
MAIL_HOST
MAIL_HOST
MAIL_PORT
MAIL_PORT
APP_LOCALE
APP_LOCALE
AWS_BUCKET
AWS_BUCKET
REDIS_HOST
REDIS_HOST
REDIS_PORT
REDIS_PORT
CACHE_STORE
CACHE_STORE
DB_DATABASE
DB_DATABASE
DB_PASSWORD
DB_PASSWORD
DB_USERNAME
DB_USERNAME
LOG_CHANNEL
LOG_CHANNEL
MAIL_MAILER
MAIL_MAILER
MAIL_SCHEME
MAIL_SCHEME
REDIS_CLIENT
REDIS_CLIENT
SESSION_PATH
SESSION_PATH
BCRYPT_ROUNDS
BCRYPT_ROUNDS
COMPOSER_AUTH
COMPOSER_AUTH
DB_CONNECTION
DB_CONNECTION
MAIL_PASSWORD
MAIL_PASSWORD
MAIL_USERNAME
MAIL_USERNAME
VITE_APP_NAME
VITE_APP_NAME
MAIL_FROM_NAME
MAIL_FROM_NAME
MEMCACHED_HOST
MEMCACHED_HOST
REDIS_PASSWORD
REDIS_PASSWORD
SESSION_DOMAIN
SESSION_DOMAIN
SESSION_DRIVER
SESSION_DRIVER
CRAWLER_API_URL
CRAWLER_API_URL
FILESYSTEM_DISK
FILESYSTEM_DISK
SESSION_ENCRYPT
SESSION_ENCRYPT
APP_FAKER_LOCALE
APP_FAKER_LOCALE
QUEUE_CONNECTION
QUEUE_CONNECTION
SESSION_LIFETIME
SESSION_LIFETIME
AWS_ACCESS_KEY_ID
AWS_ACCESS_KEY_ID
MAIL_FROM_ADDRESS
MAIL_FROM_ADDRESS
AWS_DEFAULT_REGION
AWS_DEFAULT_REGION
APP_FALLBACK_LOCALE
APP_FALLBACK_LOCALE
BROADCAST_CONNECTION
BROADCAST_CONNECTION
AWS_SECRET_ACCESS_KEY
AWS_SECRET_ACCESS_KEY
APP_MAINTENANCE_DRIVER
APP_MAINTENANCE_DRIVER
LOG_DEPRECATIONS_CHANNEL
LOG_DEPRECATIONS_CHANNEL
AWS_USE_PATH_STYLE_ENDPOINT
AWS_USE_PATH_STYLE_ENDPOINT
Redis
redis:8.2.1REDISPORT
REDISPORT
REDISUSER
REDISUSER
crawler_dashboard
jawadashraf/crawler_dashboardAPP_ENV
APP_ENV
APP_KEY
APP_KEY
APP_URL
APP_URL
DB_HOST
DB_HOST
DB_PORT
DB_PORT
APP_NAME
APP_NAME
APP_DEBUG
APP_DEBUG
LOG_LEVEL
LOG_LEVEL
LOG_STACK
LOG_STACK
MAIL_HOST
MAIL_HOST
MAIL_PORT
MAIL_PORT
APP_LOCALE
APP_LOCALE
AWS_BUCKET
AWS_BUCKET
REDIS_HOST
REDIS_HOST
REDIS_PORT
REDIS_PORT
CACHE_STORE
CACHE_STORE
DB_DATABASE
DB_DATABASE
DB_PASSWORD
DB_PASSWORD
DB_USERNAME
DB_USERNAME
LOG_CHANNEL
LOG_CHANNEL
MAIL_MAILER
MAIL_MAILER
MAIL_SCHEME
MAIL_SCHEME
REDIS_CLIENT
REDIS_CLIENT
SESSION_PATH
SESSION_PATH
BCRYPT_ROUNDS
BCRYPT_ROUNDS
COMPOSER_AUTH
COMPOSER_AUTH
DB_CONNECTION
DB_CONNECTION
MAIL_PASSWORD
MAIL_PASSWORD
MAIL_USERNAME
MAIL_USERNAME
VITE_APP_NAME
VITE_APP_NAME
MAIL_FROM_NAME
MAIL_FROM_NAME
MEMCACHED_HOST
MEMCACHED_HOST
REDIS_PASSWORD
REDIS_PASSWORD
SESSION_DOMAIN
SESSION_DOMAIN
SESSION_DRIVER
SESSION_DRIVER
CRAWLER_API_URL
CRAWLER_API_URL
FILESYSTEM_DISK
FILESYSTEM_DISK
SESSION_ENCRYPT
SESSION_ENCRYPT
APP_FAKER_LOCALE
APP_FAKER_LOCALE
QUEUE_CONNECTION
QUEUE_CONNECTION
SESSION_LIFETIME
SESSION_LIFETIME
AWS_ACCESS_KEY_ID
AWS_ACCESS_KEY_ID
MAIL_FROM_ADDRESS
MAIL_FROM_ADDRESS
AWS_DEFAULT_REGION
AWS_DEFAULT_REGION
APP_FALLBACK_LOCALE
APP_FALLBACK_LOCALE
BROADCAST_CONNECTION
BROADCAST_CONNECTION
AWS_SECRET_ACCESS_KEY
AWS_SECRET_ACCESS_KEY
APP_MAINTENANCE_DRIVER
APP_MAINTENANCE_DRIVER
CRAWLER_WEBHOOK_SECRET
CRAWLER_WEBHOOK_SECRET
LOG_DEPRECATIONS_CHANNEL
LOG_DEPRECATIONS_CHANNEL
AWS_USE_PATH_STYLE_ENDPOINT
AWS_USE_PATH_STYLE_ENDPOINT
PGDATA
PGDATA
PGPORT
PGPORT
POSTGRES_DB
POSTGRES_DB
POSTGRES_USER
POSTGRES_USER
SSL_CERT_DAYS
SSL_CERT_DAYS
RAILWAY_DEPLOYMENT_DRAINING_SECONDS
RAILWAY_DEPLOYMENT_DRAINING_SECONDS
crawler_api
jawadashraf/price_crawlerUSE_PROXY
USE_PROXY
PROXY_URLS
PROXY_URLS
BROKER_TYPE
BROKER_TYPE
SERVICE_TYPE
SERVICE_TYPE
MAX_REQUEST_DELAY
MAX_REQUEST_DELAY
MIN_REQUEST_DELAY
MIN_REQUEST_DELAY
CONFIDENCE_THRESHOLD
CONFIDENCE_THRESHOLD
ENABLE_GOOGLE_FALLBACK
ENABLE_GOOGLE_FALLBACK
MAX_MATCHES_PER_PRODUCT
MAX_MATCHES_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
MAX_REQUESTS_PER_PRODUCT
MATCHING_BRAND_PREFIX_STRIP_ENABLED
MATCHING_BRAND_PREFIX_STRIP_ENABLED
