Currents incident

Run timeouts end unresponsive results

Minor Resolved View vendor source →

Currents experienced a minor incident on July 29, 2024, lasting 2h 3m. The incident has been resolved; the full update timeline is below.

Started
Jul 29, 2024, 03:21 PM UTC
Resolved
Jul 29, 2024, 05:24 PM UTC
Duration
2h 3m
Detected by Pingoru
Jul 29, 2024, 03:21 PM UTC

Update timeline

  1. investigating Jul 29, 2024, 03:21 PM UTC

    We are currently investigating this incident. We're seeing a spike in processing load, that has resulting in a slowdown in results processing. This is having other cascading effects on how results and run progress is being shown in our system, including causing run timeouts..

  2. monitoring Jul 29, 2024, 04:03 PM UTC

    We've increased our task processing capacity, and have restored performance. We continue to investigate and monitor..

  3. resolved Jul 29, 2024, 05:24 PM UTC

    Incident is now resolved. We've identified the poorly performing query that was the cause..