Airbrake experienced a minor incident on June 3, 2019 affecting Web App and Notifications, lasting 9h 26m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 03, 2019, 04:25 AM UTC
Some accounts may be experiencing delays in error processing. We’re actively investigating and will post an update once we learn more. If you have any questions, please contact us at [email protected].
- investigating Jun 03, 2019, 08:08 AM UTC
We are continuing to investigate this issue.
- investigating Jun 03, 2019, 08:10 AM UTC
Some customers may also experience an empty error dashboard. We're working hard to fix this as soon as possible.
- identified Jun 03, 2019, 10:12 AM UTC
A fix is being implemented. We hope to be fully operational in approximately 1 hour, but it's difficult to predict at this time. We are very sorry for this major disruption. We are working hard to resolve it quickly. If you have any questions or concerns, you can reach us at [email protected].
- monitoring Jun 03, 2019, 11:32 AM UTC
The fix was successful and is complete, we expect to be fully restored to normal operation very soon. We are processing a large backlog of error data and as a result, errors that occurred in your projects during the last ~12 hours are likely to start appearing and raising notifications. We are extremely sorry for this delay and unsatisfactory service. We'll close with a more detailed postmortem, soon.
- resolved Jun 03, 2019, 01:52 PM UTC
All systems are back to normal and the backlog of data has been fully processed. Some errors that occurred during the last (approximately) 12 hours will have been late to appear on your dashboard and to raise notifications. During this incident, we had some large delays in processing errors resulting in out-of-date dashboard data and late error notifications. This is not acceptable service and for this, we're very sorry. We're working hard to learn and improve from what happened.