Zeta experienced a major incident on November 7, 2025 affecting Event Service, lasting 6h 50m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 07, 2025, 05:21 PM UTC
We are experiencing minor delays in event processing due to a temporary backlog. The incoming rate has stabilized, and our systems are actively clearing the queue. All pipelines remain healthy, and no data loss has been observed. During this period, a subset of event-driven workflows may reflect updates with a slight delay. We expect full normalization within the next few hours and will share updates as progress continues.
- investigating Nov 07, 2025, 05:21 PM UTC
We are continuing to investigate this issue.
- identified Nov 07, 2025, 06:14 PM UTC
We are continuing to work through the event processing delays and have elevated the incident priority to accelerate resolution. Our teams have identified the root cause contributing to higher-than-expected load, and mitigation steps are actively in progress. All core data pipelines remain stable, and there is no indication of data loss. Some event-driven workflows may continue to experience delayed updates as systems recover.
- identified Nov 07, 2025, 08:13 PM UTC
Recovery is well underway, and the event backlog continues to reduce steadily. System capacity has been fully scaled to accelerate processing, and we expect all delayed events to be cleared within the next few hours. During this time, some event-driven workflows may still reflect updates with brief delays. Our teams are closely monitoring throughput and stability, and we’ll provide a final update once normal processing has fully resumed.
- identified Nov 07, 2025, 10:03 PM UTC
Recovery continues to progress well, and system performance is steadily returning to normal. We now expect full recovery within the next two hours. All pipelines remain stable, and no data loss has been detected. Some of the event-driven workflows may still experience brief delays until processing is fully caught up. We’ll share an update as soon as normal operations are fully restored.
- monitoring Nov 07, 2025, 11:48 PM UTC
Recovery is complete, and all systems are now operating normally as of 3:21 pm PST. The event backlog has been completely cleared, and event-driven workflows are functioning as expected. We’ll continue to monitor closely to ensure ongoing stability and performance. Thank you for your patience while recovery efforts were completed.
- resolved Nov 08, 2025, 12:11 AM UTC
This issue is now fully resolved.