Ionic Framework incident

[Appflow Dashboard] Dashboard Access Issues & 504 Errors

Major Resolved View vendor source →

Ionic Framework experienced a major incident on January 12, 2022 affecting Ionic Appflow Dashboard, lasting 4h 50m. The incident has been resolved; the full update timeline is below.

Started
Jan 12, 2022, 01:16 PM UTC
Resolved
Jan 12, 2022, 06:06 PM UTC
Duration
4h 50m
Detected by Pingoru
Jan 12, 2022, 01:16 PM UTC

Affected components

Ionic Appflow Dashboard

Update timeline

  1. investigating Jan 12, 2022, 01:16 PM UTC

    We are currently investigating an issue that is resulting in 504 errors for the Ionic Dashboard. This may result in users being unable to access the Dashboard or their applications.

  2. monitoring Jan 12, 2022, 02:34 PM UTC

    A fix has been implemented and the Appflow Dashboard service is now recovering. We will monitor the situation to ensure the problems are resolved. Thanks for your patience.

  3. resolved Jan 12, 2022, 06:06 PM UTC

    The incident has been resolved. Please do contact Ionic support if you are seeing any further issues. Thanks for your patience.

  4. postmortem Jan 13, 2022, 07:32 PM UTC

    _Appflow was completely unavailable for approximately two hours between 12:11 UTC \(6:11am CT\) and 14:18 UTC \(8:18am CT\). The outage occurred when a Redis cache ran out of memory due to a task queue growing uncontrollably. We’ve added additional monitoring of the specific queue and fixed the bug causing the large number of tasks to get enqueued._