Stensul experienced a notice incident on August 18, 2020, lasting —. The incident has been resolved; the full update timeline is below.
Update timeline
- resolved Aug 18, 2020, 03:01 PM UTC
At approximately 9:15 AM EST a few customers started to experience a high error rate in the form of timeouts when triggering various actions in the platform. Internal services were not responding to the liveness probe by the cluster orchestrator. As a result, pods were moved to a non-degraded node. During this failover, some network traffic was dropped. Our team identified that the issue was related to a high latency spike between two zones in our cloud provider GCP that lasted for around 10 minutes, which has since been resolved.