Aula Education incident

Delayed notifications in culc-coventry

Minor Resolved View vendor source →

Aula Education experienced a minor incident on February 9, 2023 affecting Notifications, lasting 3h 20m. The incident has been resolved; the full update timeline is below.

Started
Feb 09, 2023, 05:39 PM UTC
Resolved
Feb 09, 2023, 08:59 PM UTC
Duration
3h 20m
Detected by Pingoru
Feb 09, 2023, 05:39 PM UTC

Affected components

Notifications

Update timeline

  1. investigating Feb 09, 2023, 05:39 PM UTC

    We have detected a delay in notifications in culc-coventry and are currently investigating. Push and email notifications may be delayed. The delay appears to be caused by a high volume of notifications being generated from a small set of spaces with a large number of members.

  2. identified Feb 09, 2023, 06:59 PM UTC

    We are increasing the infrastructure provision for handling notifications in order to mitigate the ongoing load.

  3. monitoring Feb 09, 2023, 08:30 PM UTC

    With the increased provision in place - the notification backlog has cleared. We will continue to monitor the system.

  4. resolved Feb 09, 2023, 08:59 PM UTC

    Notifications are no longer delayed, the incident is resolved.