Railway incident

Elevated deployment latency

Resolved after 1 hour 29 minutes, affecting US East (Virginia, USA) (Deployments (US East)) and US West (California, USA) (Deployments (US West)) and 1 more, on July 15, 2025.

resolved Jul 15, 2025, 05:55 PM UTC

Our deployment pipeline throughput was impacted by a resource constraint on the database backing our Temporal cluster. We have increased cluster resources and upgraded the database; we have seen deployment throughput restored.

Started
Jul 15, 2025, 04:26 PM UTC
Resolved
Jul 15, 2025, 05:55 PM UTC
Duration
1h 29m
Detected by Pingoru
Jul 15, 2025, 04:26 PM UTC

Affected components

US East (Virginia, USA) (Deployments (US East))US West (California, USA) (Deployments (US West))EU West (Amsterdam, Netherlands) (Deployments (EU West))Southeast Asia (Singapore) (Deployments (Southeast Asia))

Update timeline

  1. investigating Jul 15, 2025, 04:26 PM UTC

    We are investigating a number of deploys that are stuck initializing. Non-Pro deployments have been temporarily paused.

  2. investigating Jul 15, 2025, 05:00 PM UTC

    We continue to investigate the issue and have halted some active background operations to relieve the deployment delays

  3. identified Jul 15, 2025, 05:15 PM UTC

    Deployments are now processing as we're reducing the queue backpressure. We have halted some background operations to relieve deployment delays.

  4. monitoring Jul 15, 2025, 05:42 PM UTC

    Queue backpresssure has significantly reduced, we have re-enabled non-pro deployments and are monitoring

  5. resolved Jul 15, 2025, 05:55 PM UTC

    Our deployment pipeline throughput was impacted by a resource constraint on the database backing our Temporal cluster. We have increased cluster resources and upgraded the database; we have seen deployment throughput restored.

Your product runs on more than Railway

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →