Resolved after 19 minutes, on February 24, 2015.
Snitch check-ins between 15:30 UTC and 15:49 UTC were accepted but not processed. We brought check-ins back online, but the check-ins during the outage have been lost. We have discovered that check-ins were not run due to incorrectly telling our queue that we had failed a message. We mistakenly were not telling the queue to requeue the failed message and it was instead being dropped.
Update timeline
- resolved Feb 24, 2015, 04:15 PM UTC
Snitch check-ins between 15:30 UTC and 15:49 UTC were accepted but not processed. We brought check-ins back online, but the check-ins during the outage have been lost. We have discovered that check-ins were not run due to incorrectly telling our queue that we had failed a message. We mistakenly were not telling the queue to requeue the failed message and it was instead being dropped.
Your product runs on more than Dead Man's Snitch
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services