Hibob incident
We’ve identified an issue with our Sandbox environment
Hibob experienced a critical incident on August 21, 2025 affecting Sandbox, lasting 1h 41m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Aug 21, 2025, 07:41 AM UTC
We are currently investigating an issue causing errors when accessing the Sandbox environment.
- monitoring Aug 21, 2025, 08:11 AM UTC
A fix has been implemented and we are monitoring the results.
- monitoring Aug 21, 2025, 08:16 AM UTC
We are continuing to monitor for any further issues.
- resolved Aug 21, 2025, 08:34 AM UTC
Some customers experienced errors and timeouts in our Sandbox environment. Root cause: A change intended to upgrade our network communication and monitoring introduced a protocol incompatibility between services, which disrupted inter-service communication. Fix: We quickly rolled back the change, and Sandbox has been stable since. Scope: Impact was limited to Sandbox; we have no evidence of impact to production environments. We’re improving our rollout safeguards by adding protocol-compatibility tests, staged/canary deployments, and tighter monitoring to prevent a recurrence.