Dead Man's Snitch incident

Email Check-Ins not being received

Minor Resolved View vendor source →

Dead Man's Snitch experienced a minor incident on December 7, 2021 affecting Snitch Check-in Processing, lasting 1h 26m. The incident has been resolved; the full update timeline is below.

Started
Dec 07, 2021, 04:47 PM UTC
Resolved
Dec 07, 2021, 06:13 PM UTC
Duration
1h 26m
Detected by Pingoru
Dec 07, 2021, 04:47 PM UTC

Affected components

Snitch Check-in Processing

Update timeline

  1. identified Dec 07, 2021, 04:47 PM UTC

    Email check-ins for Snitches are currently returning "451 Temporary Service Failure" to at least one of our email receivers. We believe this may be related to issues in Amazon US-East-1 region. We're currently trying to work around the issue.

  2. identified Dec 07, 2021, 05:23 PM UTC

    We've updated our inbound email servers in DNS to deprioritize inbound-smtp.us-east-1.amazonaws.com. Email receiving should start to recover as servers receive the new MX record and retry pending emails.

  3. resolved Dec 07, 2021, 06:13 PM UTC

    Email check-ins are back to normal levels. We're looking into why inbound servers didn't retry with our alternate server and ways to avoid this situation in the future.