Radar incident

Elevated API Errors

Minor Resolved View vendor source →

Radar experienced a minor incident on June 11, 2025 affecting Track API, lasting 3h 40m. The incident has been resolved; the full update timeline is below.

Started
Jun 11, 2025, 01:03 PM UTC
Resolved
Jun 11, 2025, 04:43 PM UTC
Duration
3h 40m
Detected by Pingoru
Jun 11, 2025, 01:03 PM UTC

Affected components

Track API

Update timeline

  1. investigating Jun 11, 2025, 01:03 PM UTC

    We're experiencing an elevated level of API errors and are currently looking into the issue.

  2. monitoring Jun 11, 2025, 01:15 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. monitoring Jun 11, 2025, 01:49 PM UTC

    We are continuing to see isolated brief jumps in latencies and errors lasting 1-2 minutes. On-call engineers are continuing to work on this issue.

  4. monitoring Jun 11, 2025, 02:26 PM UTC

    On-call engineers are continuing to work on this issue.

  5. monitoring Jun 11, 2025, 03:15 PM UTC

    On-call engineers are continuing to work on this issue.

  6. monitoring Jun 11, 2025, 03:52 PM UTC

    On-call engineers are continuing to work on this issue.

  7. monitoring Jun 11, 2025, 04:35 PM UTC

    We have identified the potential cause as a period of packet loss between us-east-1 and us-east-2 in AWS, two regions where Radar is hosted. More information here: https://health.aws.amazon.com/health/status

  8. resolved Jun 11, 2025, 04:43 PM UTC

    This incident has been resolved.