Simplr incident

Delay in message processing for multiple clients

Major Resolved View vendor source →

Simplr experienced a major incident on September 2, 2019, lasting —. The incident has been resolved; the full update timeline is below.

Started
Sep 02, 2019, 10:00 PM UTC
Resolved
Sep 02, 2019, 10:00 PM UTC
Duration
Detected by Pingoru
Sep 02, 2019, 10:00 PM UTC

Update timeline

  1. resolved Oct 30, 2019, 06:07 PM UTC

    Delay in message processing for multiple clients

  2. postmortem Oct 30, 2019, 06:07 PM UTC

    Volume from a single client delayed processing of messages for multiple clients. Message processing time came back to current once the volume died down. 20x normal volume was observed from the client. Additional processing queues were added to prevent this from happening in the future.