Bolt incident

Capacity to process orders is degraded

Major Resolved View vendor source →

Bolt experienced a major incident on March 15, 2023 affecting Checkout and Merchant Dashboard and 1 more component, lasting 45m. The incident has been resolved; the full update timeline is below.

Started
Mar 15, 2023, 11:20 PM UTC
Resolved
Mar 16, 2023, 12:05 AM UTC
Duration
45m
Detected by Pingoru
Mar 15, 2023, 11:20 PM UTC

Affected components

CheckoutMerchant DashboardBolt SSOBolt Accounts

Update timeline

  1. investigating Mar 15, 2023, 10:58 PM UTC

    There is an issue that is causing a significant percentage of orders processed by Bolt to fail. This issue is also impacting the Merchant Dash, SSO and other components. We are urgently working on a fix for this.

  2. investigating Mar 15, 2023, 11:20 PM UTC

    We have an understanding of what the problem is and are we are able to manual mitigate the issue. We are seeing systems availability increase. Our team is continuing to drive to a permanent solution to this issue. We will provide regular updates on our progress.

  3. identified Mar 15, 2023, 11:20 PM UTC

    We have an understanding of what the problem is and are we are able to manual mitigate the issue. We are seeing systems availability increase. Our team is continuing to drive to a permanent solution to this issue. We will provide regular updates on our progress.

  4. identified Mar 15, 2023, 11:38 PM UTC

    We have deployed a fix for one of identified issues and have determined that it is working. We are in the process of rolling this fix out to the rest of the system and expect to have the system fully back within the next 15 minutes.

  5. monitoring Mar 15, 2023, 11:57 PM UTC

    We deployed all the needed fixes and all systems are up and running. We are continuing to monitor the situation. We are also experiencing a helpdesk failure - if you are continuing to see issues, please reach out to us here: [email protected]

  6. resolved Mar 16, 2023, 12:05 AM UTC

    We have confirmed that all the fixes were deployed successful and we are considering the issue resolve. Our team will continue to monitor the situation. We will publish an RCA for this incident. Additionally, our helpdesk is back up and running. Please use our help site (help.bolt.com) or email us at [email protected] if you see any issues or have questions.