Radar incident

Elevated API errors

Major Resolved View vendor source →

Radar experienced a major incident on July 30, 2024 affecting Webhooks and Search APIs and 1 more component, lasting 7h 48m. The incident has been resolved; the full update timeline is below.

Started
Jul 30, 2024, 10:21 PM UTC
Resolved
Jul 31, 2024, 06:10 AM UTC
Duration
7h 48m
Detected by Pingoru
Jul 30, 2024, 10:21 PM UTC

Affected components

WebhooksSearch APIsGeocoding APIsRouting APIs

Update timeline

  1. investigating Jul 30, 2024, 10:42 PM UTC

    We're experiencing an elevated level of API errors and are currently looking into the issue.

  2. investigating Jul 30, 2024, 10:45 PM UTC

    We are continuing to investigate this issue.

  3. identified Jul 30, 2024, 11:03 PM UTC

    An AWS outage in us-east-1 (https://health.aws.amazon.com/health/status?eventID=arn:aws:health:us-east-1::event/MULTIPLE_SERVICES/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE/AWS_MULTIPLE_SERVICES_OPERATIONAL_ISSUE_F0449_625BDDE4846) is impacting maps APIs, the dashboard, and third-party integrations and webhooks. Track APIs are unaffected. We are standing up services in different, unaffected regions while AWS works to restore service in us-east-1.

  4. identified Jul 30, 2024, 11:07 PM UTC

    We are continuing to work on a fix for this issue.

  5. identified Jul 30, 2024, 11:20 PM UTC

    We are continuing to work on a fix for this issue.

  6. monitoring Jul 31, 2024, 02:03 AM UTC

    Although we have successfully restored services in a different region, issues in us-east-1 appear to be resolving, and maps APIs and the dashboard are operational again. Third-party integrations and webhooks are still delayed.

  7. monitoring Jul 31, 2024, 03:30 AM UTC

    Third-party integrations and webhooks are on pace to catch up completely over the next several hours.

  8. resolved Jul 31, 2024, 06:10 AM UTC

    This incident has been resolved.