ID Dataweb incident

Production Cluster-Related Issues

Major Resolved View vendor source →

ID Dataweb experienced a major incident on March 20, 2025 affecting AXN and API and 1 more component, lasting 3h 20m. The incident has been resolved; the full update timeline is below.

Started
Mar 20, 2025, 04:21 PM UTC
Resolved
Mar 20, 2025, 07:41 PM UTC
Duration
3h 20m
Detected by Pingoru
Mar 20, 2025, 04:21 PM UTC

Affected components

AXNAPIAdminGatewayAttribute Providers

Update timeline

  1. investigating Mar 20, 2025, 04:06 PM UTC

    We are rapidly investigating an infrastructure issue affecting our PreProduction and Production environments and will provide updates shortly. The majority of traffic is currently believed to be affected including access to the admin console.

  2. investigating Mar 20, 2025, 04:09 PM UTC

    We are continuing to investigate this issue.

  3. investigating Mar 20, 2025, 04:21 PM UTC

    Service has been partially restored and the team is monitoring the relevant infrastructure changes.

  4. investigating Mar 20, 2025, 04:33 PM UTC

    Service has been restored for Gateway customers and remains unavailable for API customers; we are actively resolving the issue and scaling back up relevant infrastructure.

  5. investigating Mar 20, 2025, 04:38 PM UTC

    We are continuing to investigate this issue.

  6. identified Mar 20, 2025, 05:29 PM UTC

    An issue with one of our Production clusters in US-East-1 (AWS) resulted in a partial failover to US-East-2; our team has identified the issue with the failover instance and is working on the fix. Services remain unavailable to API customers and degraded for Gateway customers; access to the admin console also remains degraded at this time. We will provide updates within every hour until resolution. We understand the impact of this incident and appreciate your patience. Please contact [email protected] with any questions or concerns.

  7. monitoring Mar 20, 2025, 05:37 PM UTC

    Our team has fully resolved the related infrastructure issues and all services are fully operational for all customers at this time. We will continue to monitor performance and follow-up directly with a RCA. Incident Start: 03/20/2025, 11:50 AM EST Incident End: 03/20/2025, 01:30 PM EST Incident Duration: 1h 40m You can check this page (status.iddataweb.com) regularly or subscribe to its updates per your preference. Please contact [email protected] with any additional questions or concerns.

  8. resolved Mar 20, 2025, 07:41 PM UTC

    This incident has been resolved and an RCA will be provided as soon as possible.