Home Configure incident

Production Outage

Resolved after 4 hours 51 minutes, affecting Omnibuilder Service and Image Cache and 1 more, on July 18, 2024.

monitoring Jul 19, 2024, 02:32 AM UTC

Microsoft has reported that they've determined the underlying cause and are now applying mitigation measures. We're beginning to see some systems recover as a result, however, not all systems have recovered at this time. We will continue to update this incident as services are restored.

Started
Jul 18, 2024, 10:24 PM UTC
Resolved
Jul 19, 2024, 03:16 AM UTC
Duration
4h 51m
Detected by Pingoru
Jul 18, 2024, 10:24 PM UTC

Affected components

Omnibuilder ServiceImage CacheRenderingWebCenterpoint

Update timeline

  1. investigating Jul 18, 2024, 10:24 PM UTC

    We are experiencing a production outage. Active investigation is in progress.

  2. identified Jul 18, 2024, 10:33 PM UTC

    Azure hosting is having regional outage. This is the cause of our outage. We are investigating solutions.

  3. identified Jul 18, 2024, 10:59 PM UTC

    There are widespread Azure failures across the central US. Microsoft has released an impact statement that many services and VM’s are experiencing connection failures, including Paradigm customers, and it is being investigated within Azure. We’ll be providing updates as we have them.

  4. identified Jul 19, 2024, 01:37 AM UTC

    Microsoft has determined the cause and is working towards a resolution. We are working towards our own remediation, but it may prove unnecessary if Microsoft services are restored.

  5. monitoring Jul 19, 2024, 02:32 AM UTC

    Microsoft has reported that they've determined the underlying cause and are now applying mitigation measures. We're beginning to see some systems recover as a result, however, not all systems have recovered at this time. We will continue to update this incident as services are restored.

  6. resolved Jul 19, 2024, 03:16 AM UTC

    Services have been restored.

Your product runs on more than Home Configure

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →