Flash incident

Potential service degradation

Minor Resolved View vendor source →

Flash experienced a minor incident on September 19, 2023 affecting FlashValet and FlashPARCS, lasting 1h 13m. The incident has been resolved; the full update timeline is below.

Started
Sep 19, 2023, 06:12 PM UTC
Resolved
Sep 19, 2023, 07:26 PM UTC
Duration
1h 13m
Detected by Pingoru
Sep 19, 2023, 06:12 PM UTC

Affected components

FlashValetFlashPARCS

Update timeline

  1. investigating Sep 19, 2023, 06:12 PM UTC

    We are receiving reports of delayed transaction times and difficultly accessing the Flash portal. Our team is currently investigating.

  2. investigating Sep 19, 2023, 06:48 PM UTC

    We are actively investigating the issue at the moment. We have identified a failure in a 3rd party Microsoft component. We will have another status update shortly.

  3. investigating Sep 19, 2023, 06:55 PM UTC

    The 3rd party vendor issue is resolving. We anticipate to be back to full service in roughly twenty minutes.

  4. monitoring Sep 19, 2023, 07:09 PM UTC

    Our 3rd party vendor, Microsoft, has resolved their issue. Site performance and health is returning to normal. We are monitoring and anticipate giving a final all-clear in the next 5 to 10 minutes.

  5. resolved Sep 19, 2023, 07:26 PM UTC

    The site continues to return to expected performance and health. We are continuing to monitor both our platform and Microsoft's. Please return to the standard normal "gates down" procedures. If you still have issues at your site, please get in touch with your Flash representative, and we will investigate. We will publish a complete incident response and post-mortem shortly. We will immediately notify you through this status page if we anticipate further issues with our vendor. Anthony Broad-Crawford, CTO

  6. postmortem Sep 19, 2023, 10:40 PM UTC

    The Flash On-Call and Site Reliability teams continue to monitor and will do so through the evening, night, and early morning rush hour tomorrow. Currently, all systems remain healthy. A detailed incident summary from this afternoon is available [here](https://drive.google.com/file/d/1_dM1z8feHkbzwHOnI1uvLlXACKFX1vXh/view). Thank you. Anthony Broad-Crawford, CTO