RG System incident

Having issues at scheduling Microsoft 365 Backup

Critical Resolved View vendor source →

RG System experienced a critical incident on September 26, 2022 affecting Microsoft 365 Backup, lasting 9d 4h. The incident has been resolved; the full update timeline is below.

Started
Sep 26, 2022, 08:12 AM UTC
Resolved
Oct 05, 2022, 12:19 PM UTC
Duration
9d 4h
Detected by Pingoru
Sep 26, 2022, 08:12 AM UTC

Affected components

Microsoft 365 Backup

Update timeline

  1. investigating Sep 26, 2022, 08:12 AM UTC

    We're having trouble at scheduling backups on Office 365 Backup Cluster, a subset of customers might be impacted

  2. identified Sep 26, 2022, 08:18 AM UTC

    We are having trouble authenticating at Microsoft. We're looking for a workaround.

  3. identified Sep 26, 2022, 08:18 AM UTC

    We are continuing to work on a fix for this issue.

  4. identified Sep 26, 2022, 12:56 PM UTC

    We have an open case at Microsoft, and we're looking for a workaround.

  5. monitoring Sep 29, 2022, 09:26 AM UTC

    Microsoft is releasing a patch on September 30th, in the meantime, we've been rolling out a version that allows users to update manually the Azure Application Certificates to make the backup system work again. If you didn't receive a mail containing information related to certificate renewing, you're all set.

  6. monitoring Sep 29, 2022, 11:07 AM UTC

    We are continuing to monitor for any further issues.

  7. resolved Oct 05, 2022, 12:19 PM UTC

    This incident has been resolved.