Keepit incident

Problems backing up Office 365 Groups

Minor Resolved View vendor source →

Keepit experienced a minor incident on June 21, 2023 affecting SaaS Backup and SaaS Backup and 1 more component, lasting 5d 5h. The incident has been resolved; the full update timeline is below.

Started
Jun 21, 2023, 03:12 PM UTC
Resolved
Jun 26, 2023, 08:49 PM UTC
Duration
5d 5h
Detected by Pingoru
Jun 21, 2023, 03:12 PM UTC

Affected components

SaaS BackupSaaS BackupSaaS BackupSaaS BackupSaaS BackupSaaS Backup

Update timeline

  1. identified Jun 21, 2023, 03:12 PM UTC

    We're temporarily experiencing a problem backing up Office 365 Groups in all regions worldwide. The Microsoft Graph endpoint we use to read group data is unexpectedly rejecting our requests, meaning that we cannot read Group data for those requests. We are investigating with Microsoft. Next update 1600Z 22 June 2023

  2. monitoring Jun 22, 2023, 01:49 PM UTC

    We have implemented a fix for this issue and are continuing to monitor the results. Backup jobs are running normally in all regions. Microsoft support is engaged to help us with root cause identification. Next update before 1600Z 26 Jun 2023

  3. resolved Jun 26, 2023, 08:49 PM UTC

    Our fix is stable and the problem is resolved. Microsoft support is still investigating the root cause and we will work with them to minimize chances of a recurrence.