Front incident
Failures to send emails on Gmail channels [gmail]
Front experienced a major incident on August 8, 2024 affecting Gmail, lasting 18h 28m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Aug 08, 2024, 10:09 PM UTC
We are seeing failures to send emails on Gmail channels due to an authentication issue and we are investigating.
- investigating Aug 08, 2024, 10:10 PM UTC
We are seeing failures to send emails on Gmail channels due to an authentication issue and we are investigating.
- investigating Aug 08, 2024, 10:40 PM UTC
Our engineering team is continuing to investigate this issue.
- identified Aug 08, 2024, 11:40 PM UTC
We believe the incident is related to an ongoing global incident disrupting aspects of Gmail's service and platform (https://www.google.com/appsstatus/dashboard/incidents/G4vfJGa9LyWQjK4hiiHA). We're continuing to investigate possible mitigations to restore full service to Front's customers.
- identified Aug 09, 2024, 12:55 AM UTC
We are continuing to observe errors for a small percentage of Gmail traffic, and are continuing to investigate.
- monitoring Aug 09, 2024, 02:02 PM UTC
The vast majority of Gmail traffic has returned to a healthy state; a very small number of Gmail channels appear to still be in the process of self repairing. We're continuing to monitor the situation.
- resolved Aug 09, 2024, 04:38 PM UTC
Almost all Gmail traffic has now returned to a healthy state, with our retry mechanisms expected to restore full service to the small number of channels that are experiencing delays, in the coming hours.