Felix incident

Some notification emails relating to RFQs are not being sent

Minor Resolved View vendor source →

Felix experienced a minor incident on February 20, 2023 affecting Notifications, lasting 6h 3m. The incident has been resolved; the full update timeline is below.

Started
Feb 20, 2023, 11:51 PM UTC
Resolved
Feb 21, 2023, 05:55 AM UTC
Duration
6h 3m
Detected by Pingoru
Feb 20, 2023, 11:51 PM UTC

Affected components

Notifications

Update timeline

  1. identified Feb 20, 2023, 11:51 PM UTC

    Our internal monitoring system had alerted us that a number of notification emails are not being sent. A probable cause had been identified and the Engineering team is currently working to resolve this issue.

  2. identified Feb 21, 2023, 12:08 AM UTC

    Further investigation confirms only email notifications relating to RFQ. The Engineering team is working on remediation.

  3. monitoring Feb 21, 2023, 01:46 AM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Feb 21, 2023, 05:55 AM UTC

    This incident has been resolved.