Pike13 incident

Reporting delays

Minor Resolved View vendor source →

Pike13 experienced a minor incident on July 9, 2025 affecting Reporting, lasting 1d 13h. The incident has been resolved; the full update timeline is below.

Started
Jul 09, 2025, 02:02 PM UTC
Resolved
Jul 11, 2025, 04:01 AM UTC
Duration
1d 13h
Detected by Pingoru
Jul 09, 2025, 02:02 PM UTC

Affected components

Reporting

Update timeline

  1. investigating Jul 09, 2025, 02:02 PM UTC

    We are currently investigating an issue with reporting data not being updated.

  2. investigating Jul 09, 2025, 03:40 PM UTC

    The issue has been resolved. Replication is catching up. Stay tuned here for updates on latency reduction until fully caught up.

  3. investigating Jul 09, 2025, 03:49 PM UTC

    Reporting latency is currently approximately 24 hours behind.

  4. investigating Jul 09, 2025, 04:32 PM UTC

    Data latency in reporting continues to slowly decrease. We are constantly monitoring the situation and will update this page at least once every four hours with the current latency until reporting data reaches expected parameters. We expect full resolution by end of day today.

  5. monitoring Jul 09, 2025, 06:26 PM UTC

    Latency continues to decrease slowly as the system processes all of the data from yesterday. It will decrease more rapidly once all of the data from peak activity hours yesterday has been processed. We still expect reporting to be fully caught up to normal latency by the end of the day today.

  6. monitoring Jul 09, 2025, 08:13 PM UTC

    Reporting data is now loaded up to 4:30pm EDT yesterday (July 8). It still needs to process the remainder of July 8, and of course catch up on July 9.

  7. monitoring Jul 09, 2025, 11:54 PM UTC

    Reporting data is now loaded up to 6:20pm EDT yesterday (July 8). Slow going as it churns through peak-time data.

  8. monitoring Jul 10, 2025, 03:53 AM UTC

    Latency is dropping more rapidly. The system has now moved on to processing data from today (July 9).

  9. monitoring Jul 10, 2025, 01:08 PM UTC

    Reporting data is now loaded up to July 9 6:15pm EDT. Still a ways to go.

  10. monitoring Jul 10, 2025, 06:21 PM UTC

    Reporting data is now loaded up through end of day July 9 EDT.

  11. monitoring Jul 10, 2025, 10:00 PM UTC

    Reporting data is now loaded up through today (July 10) 1:15pm EDT. Nearly caught up now.

  12. resolved Jul 11, 2025, 04:01 AM UTC

    Reporting data latency has returned to normal.