Courier incident

AWS serviceUnavailable Outage

Major Resolved View vendor source →

Courier experienced a major incident on June 26, 2024 affecting API, lasting 1h 20m. The incident has been resolved; the full update timeline is below.

Started
Jun 26, 2024, 01:52 AM UTC
Resolved
Jun 26, 2024, 03:12 AM UTC
Duration
1h 20m
Detected by Pingoru
Jun 26, 2024, 01:52 AM UTC

Affected components

API

Update timeline

  1. monitoring Jun 26, 2024, 01:49 AM UTC

    An incident where Courier messages resulted in "Internal Courier Error" was the result of AWS returning serviceUnavailable. The team has identified the issue and messages that responded with 5xx errors will be retried by our pipeline resilience.

  2. monitoring Jun 26, 2024, 01:52 AM UTC

    An incident where Courier messages resulted in "Internal Courier Error" was the result of AWS returning serviceUnavailable. The team has identified the issue and messages that responded with 5xx errors will be retried by our pipeline resilience.

  3. investigating Jun 26, 2024, 02:02 AM UTC

    Service has re-entered a degraded state. Sends from Courier are impacted.

  4. monitoring Jun 26, 2024, 02:29 AM UTC

    Service has resumed normal operation. Courier Engineers are monitoring.

  5. resolved Jun 26, 2024, 03:12 AM UTC

    The team has resolved the issue. Send pipeline operational.