Recart incident

We get notifications about incoming SMS messages with huge delays

Major Resolved View vendor source →

Recart experienced a major incident on November 5, 2022 affecting Messaging, lasting 17h 16m. The incident has been resolved; the full update timeline is below.

Started
Nov 05, 2022, 05:34 PM UTC
Resolved
Nov 06, 2022, 10:50 AM UTC
Duration
17h 16m
Detected by Pingoru
Nov 05, 2022, 05:34 PM UTC

Affected components

Messaging

Update timeline

  1. identified Nov 05, 2022, 05:34 PM UTC

    A downstream provider of ours sends notifications about incoming SMS messages with huge delays, because of that subscription related messages can be sent just with the very same delay.

  2. identified Nov 05, 2022, 05:52 PM UTC

    We talked to our downstream provider, they are looking into the problem.

  3. identified Nov 05, 2022, 05:57 PM UTC

    We turned every opt-in tool off to make sure end users won't get confused.

  4. identified Nov 05, 2022, 09:45 PM UTC

    We are waiting for a resolution from our downstream provider, they escalated the issue.

  5. resolved Nov 06, 2022, 10:50 AM UTC

    This incident has been resolved.