Aula Education incident

Delayed email notifications in Coventry environments

Minor Resolved View vendor source →

Aula Education experienced a minor incident on June 21, 2022 affecting Notifications, lasting 23h 37m. The incident has been resolved; the full update timeline is below.

Started
Jun 21, 2022, 01:43 PM UTC
Resolved
Jun 22, 2022, 01:20 PM UTC
Duration
23h 37m
Detected by Pingoru
Jun 21, 2022, 01:43 PM UTC

Affected components

Notifications

Update timeline

  1. investigating Jun 21, 2022, 01:43 PM UTC

    We are currently observing a higher amount of errors in our email delivery pipeline in Coventry and Coventry Group institutions. We are currently investigating the issue.

  2. investigating Jun 21, 2022, 02:22 PM UTC

    The issue appears to be with one of Coventry's email servers. We are working with the relevant team to get to the root cause of the issue.

  3. monitoring Jun 21, 2022, 03:06 PM UTC

    The email queue has now returned to normal. We will continue to monitor.

  4. monitoring Jun 21, 2022, 03:08 PM UTC

    The issue appears to have been caused by throttling from a spam provider.

  5. monitoring Jun 21, 2022, 03:25 PM UTC

    A small number of email notifications have failed to send again, reported to the Coventry IT team.

  6. identified Jun 21, 2022, 03:49 PM UTC

    We are continuing to see some emails fail to send. The Coventry IT team are investigating.

  7. resolved Jun 22, 2022, 01:20 PM UTC

    We have been monitoring the email system throughout the day and are satisfied that it is now stable.