Orb experienced a minor incident on July 30, 2024 affecting Ingest, lasting 6h 11m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jul 30, 2024, 10:46 PM UTC
We're investigating an issue with our cloud provider that is causing elevated error rates on event ingestion related endpoints. File based ingestion is not affected.
- monitoring Jul 31, 2024, 01:54 AM UTC
As of 00:40 UTC, we've seen a significant reduction in error rates on the event ingestion related endpoint. We're continuing to monitor the situation with our cloud provider.
- monitoring Jul 31, 2024, 02:32 AM UTC
We've confirmed that error rates have stopped as of 07/31/24 01:12 UTC. Our on-call team will continue to monitor the service until we see recovery from our cloud provider.
- resolved Jul 31, 2024, 04:57 AM UTC
The event ingestion service is fully operational, our on-call team will continue monitoring our systems.