GitGuardian incident
GitGuardian Internal Monitoring application stuck in Maintenance mode at 14:29 UTC
GitGuardian experienced a major incident on July 19, 2021 affecting Dashboard, lasting 29m. The incident has been resolved; the full update timeline is below.
Affected components
Dashboard
Update timeline
- identified Jul 19, 2021, 08:50 PM UTC
During an application release the application frontend and workers were stuck in Maintenance mode for longer than expected.
- identified Jul 19, 2021, 08:51 PM UTC
Issue has been identified. A fix is in progress
- resolved Jul 19, 2021, 08:55 PM UTC
Maintenance mode was removed and dashboard & workers were restored at 14:56 UTC. No incoming events were lost. A bug in the maintenance script maintained a lock on the release process. We had to manually remove the lock. A bug fix is in progress and will be deployed on the 20th.