Currents incident

Run timeouts end unresponsive results

Minor Resolved View vendor source →

Currents experienced a minor incident on July 29, 2024, lasting —. The incident has been resolved; the full update timeline is below.

Started
Jul 29, 2024, 03:21 PM UTC
Resolved
Jul 29, 2024, 03:21 PM UTC
Duration
Detected by Pingoru
Jul 29, 2024, 03:21 PM UTC

Update timeline

  1. resolved Jul 29, 2024, 03:21 PM UTC

    Type: Incident Duration: 2 hours and 4 minutes Affected Components: API - HTTP REST API, API - Dashboard Browsing, Data Ingestion Jul 29, 15:21:22 GMT+0 - Investigating - We are currently investigating this incident. We're seeing a spike in processing load, that has resulting in a slowdown in results processing. This is having other cascading effects on how results and run progress is being shown in our system, including causing run timeouts. Jul 29, 17:24:53 GMT+0 - Resolved - Incident is now resolved. We've identified the poorly performing query that was the cause. Jul 29, 16:03:28 GMT+0 - Monitoring - We've increased our task processing capacity, and have restored performance. We continue to investigate and monitor.