Metronome incident

Ingest and Alerts are delayed

Resolved after 5 days 21 hours, affecting Usage Pipeline and Alerts, on January 23, 2026.

monitoring Jan 25, 2026, 09:23 PM UTC

All issues have been mitigated, and the team is now monitoring.

Started
Jan 23, 2026, 11:30 PM UTC
Resolved
Jan 29, 2026, 09:17 PM UTC
Duration
5d 21h
Detected by Pingoru
Jan 23, 2026, 11:30 PM UTC

Affected components

Usage PipelineAlerts

Update timeline

  1. identified Jan 23, 2026, 11:30 PM UTC

    We are investigating an increase in aggregation time, which is impacting both the usage pipeline and alert evaluation time. Ingest availability is not impacted.

  2. identified Jan 24, 2026, 12:36 AM UTC

    We are investigating an increase in aggregation time, which is impacting both the usage pipeline and alert evaluation time. Ingest availability is not impacted. Invoice finalization has been paused to ensure data integrity.

  3. identified Jan 24, 2026, 01:37 AM UTC

    We are investigating an increase in aggregation time, which is impacting both the usage pipeline and alert evaluation time, for a subset of usage events. Ingest availability is not impacted. Invoice finalization and threshold billing has been paused to ensure data integrity.

  4. identified Jan 24, 2026, 04:25 AM UTC

    We have mitigated an increase in aggregation time for a subset of usage events. Notifications remain delayed for a subset of customers. Invoice finalization and threshold billing remain paused. Ingest availability is not impacted.

  5. identified Jan 24, 2026, 06:18 AM UTC

    We have mitigated an increase in aggregation time for a subset of usage events. Notifications remain delayed for a subset of customers but delay is decreasing. Invoice finalization and threshold billing remain paused until data integrity checks complete. The team will be running data integrity checks overnight. Ingest availability is not impacted.

  6. identified Jan 24, 2026, 05:18 PM UTC

    We have identified an issue with our mitigation for aggregation and are working on resolving that issue. Aggregation time remains delayed for data ingested between 1/23 16UTC and 1/24 12UTC. Notifications remain delayed as well. Invoice finalization and threshold billing remain paused until remediation and data integrity checks complete successfully. Ingest availability is not impacted.

  7. identified Jan 25, 2026, 09:40 AM UTC

    Aggregations and notifications are caught up. We are repeating our data quality checks to ensure correctness of invoices. Invoice finalization and threshold billing remain paused until data integrity checks complete successfully. Ingest availability is not impacted.

  8. identified Jan 25, 2026, 05:59 PM UTC

    Threshold billing is unpaused. Aggregations and notifications are caught up. Invoice finalization remains paused. Ingest availability is not impacted.

  9. monitoring Jan 25, 2026, 09:23 PM UTC

    All issues have been mitigated, and the team is now monitoring.

  10. resolved Jan 29, 2026, 09:17 PM UTC

    This issue has been resolved.

Your product runs on more than Metronome

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →