PowerOutage.us incident

Azure Central Region Connectivity Issues

Critical Resolved View vendor source →

PowerOutage.us experienced a critical incident on July 18, 2024 affecting Power Outage Site and Power Outage API, lasting 16h 40m. The incident has been resolved; the full update timeline is below.

Started
Jul 18, 2024, 06:30 PM UTC
Resolved
Jul 19, 2024, 11:10 AM UTC
Duration
16h 40m
Detected by Pingoru
Jul 18, 2024, 06:30 PM UTC

Affected components

Power Outage SitePower Outage API

Update timeline

  1. identified Jul 19, 2024, 12:13 AM UTC

    Azure Central Region Connectivity Issues https://azure.status.microsoft/en-us/status We are looking into issues with Azure which are causing very high load times and errors. Check the Azure status page for more details.

  2. identified Jul 19, 2024, 12:47 AM UTC

    Azure Central Region Connectivity Issues https://azure.status.microsoft/en-us/status Primary database for PowerOutage.us is inaccessible. Any returned web and API results are cached but stale. We are working on standing up new infrastructure in US West

  3. monitoring Jul 19, 2024, 02:34 AM UTC

    Azure Central Region Connectivity Issues https://azure.status.microsoft/en-us/status Our primary database is back up and data is updating system wide. We are monitoring the situation and double checking that everything is working. The incident is still ongoing on Azure's end.

  4. resolved Jul 19, 2024, 11:10 AM UTC

    Azure has fully recovered US Central; no other issues have been found on our end. If anyone runs into anything reach out to us at [email protected] We will be making improvements to our redundancy, we were multi-zone redundant before this incident but will be expanding to multi-region redundancy, we now have a backup stack available in Azure US West and will be fleshing that out and testing failover in the coming weeks.