TrackTik experienced a notice incident on April 24, 2020 affecting Email Notifications, lasting 1h 20m. The incident has been resolved; the full update timeline is below.
Affected components
Email Notifications
Update timeline
- identified Apr 24, 2020, 11:21 PM UTC
Around 6:40 PM EST today we have identified delays in message delivery, and are actively investigating. Messages are currently QUEUED and will Resume the items in the queue once we resolve the issue. We will send an additional update in 60 minutes.
- monitoring Apr 24, 2020, 11:45 PM UTC
A fix has been implemented and we are monitoring the results.
- resolved Apr 25, 2020, 12:42 AM UTC
The error is fixed, and the jobs are executing again. The problem was caused by our cron job server that stopped executing the jobs. we located a misconfiguration in one of the agents that may have caused a temporary failure.