Simplr incident

Reduced email throughput

Minor Resolved View vendor source →

Simplr experienced a minor incident on May 7, 2021, lasting 15m. The incident has been resolved; the full update timeline is below.

Started
May 07, 2021, 07:30 PM UTC
Resolved
May 07, 2021, 07:45 PM UTC
Duration
15m
Detected by Pingoru
May 07, 2021, 07:30 PM UTC

Update timeline

  1. resolved May 07, 2021, 10:21 PM UTC

    Event messages for email are being processed at lower throughput due to a backend system api limit. A new event queue was created to process messages through a new channel.

  2. postmortem May 08, 2021, 12:02 AM UTC

    Unusually high traffic from a partner caused the queue head to fill up reducing throughput on other partners. High traffic partner was separated into its own queue.