INKY incident

Inky US dashboard is experiencing issues

Major Resolved View vendor source →

INKY experienced a major incident on June 7, 2023 affecting Dashboard Services US, lasting 4d 17h. The incident has been resolved; the full update timeline is below.

Started
Jun 07, 2023, 06:29 PM UTC
Resolved
Jun 12, 2023, 12:18 PM UTC
Duration
4d 17h
Detected by Pingoru
Jun 07, 2023, 06:29 PM UTC

Affected components

Dashboard Services US

Update timeline

  1. investigating Jun 07, 2023, 06:29 PM UTC

    Inky is currently investigating an issue affecting the US production dashboard. Customers may not be able to retrieve graphs and metrics from the dashboard at this time and may experience a timeout. Inky engineers are investigating the issue now. Settings may still be changed via the https://app.inkyphishfence.com/settings/summary page as normal.

  2. investigating Jun 07, 2023, 07:40 PM UTC

    Inky Engineers have isolated what is believed to be causing the issues with graphs on the Inky dashboard and are working toward mitigation updates will follow as available

  3. identified Jun 07, 2023, 08:42 PM UTC

    Inky Engineers are continuing to mitigate the issue and we are seeing errors dropping. Timeouts may still occur while the systems are restored.

  4. monitoring Jun 07, 2023, 10:07 PM UTC

    Inky engineers are continuing to work to ensure that the issue is fully mitigated.

  5. monitoring Jun 08, 2023, 12:44 PM UTC

    Inky engineers have mitigated the issue and will continue to monitor to ensure stability

  6. resolved Jun 12, 2023, 12:18 PM UTC

    Inky engineers confirm that the dashboard function has been fully restored