Simplr incident

Email partial system failure and processing delays

Minor Resolved View vendor source →

Simplr experienced a minor incident on November 23, 2020, lasting 32m. The incident has been resolved; the full update timeline is below.

Started
Nov 23, 2020, 03:27 AM UTC
Resolved
Nov 23, 2020, 04:00 AM UTC
Duration
32m
Detected by Pingoru
Nov 23, 2020, 03:27 AM UTC

Update timeline

  1. resolved Nov 23, 2020, 03:27 AM UTC

    Email partial failure for Zendesk and Gorgias integrations. Email routing delays.

  2. postmortem Nov 23, 2020, 03:29 AM UTC

    Redis failover resulted in platform unable to perform Redis writes on the new instance resulting in failure of various services. Webhooks from Zendesk and Gorgias integrations failed. Auto-routing failed. Restoring the Redis primary via another failover resolved the issue. All services back to normal. Team is investigating cause of Redis failover.