Kevel incident

Reporting API + UI: Unable to generate reports

Major Resolved View vendor source →

Kevel experienced a major incident on September 25, 2023 affecting Reporting, lasting 9h 26m. The incident has been resolved; the full update timeline is below.

Started
Sep 25, 2023, 02:54 AM UTC
Resolved
Sep 25, 2023, 12:20 PM UTC
Duration
9h 26m
Detected by Pingoru
Sep 25, 2023, 02:54 AM UTC

Affected components

Reporting

Update timeline

  1. identified Sep 25, 2023, 02:54 AM UTC

    We identified an issue preventing the generation of reports for API and UI users. The source of the issue has been identified, and we are working to restore functionality.

  2. monitoring Sep 25, 2023, 05:46 AM UTC

    We identified an issue caused by an automatic update from AWS. It has been rectified. We are monitoring as the system is working to run the outstanding reports.

  3. investigating Sep 25, 2023, 09:30 AM UTC

    We have identified another issue preventing the generation of reports for API and UI users. We are currently investigating. Report processing for new and existing reports will be delayed.

  4. monitoring Sep 25, 2023, 11:23 AM UTC

    We have rectified the reporting functionality. Data for reports is still being resync and we are monitoring the progress and performance.

  5. resolved Sep 25, 2023, 12:20 PM UTC

    This incident has been resolved. If you have generated a report during the incident, you are advised to run the report again.