Wasabi incident

WACM / Wasabi Account Control API - System Issues

Minor Resolved View vendor source →

Wasabi experienced a minor incident on May 29, 2025 affecting Wasabi Account Control API and Wasabi Account Control Manager Console, lasting 1h 34m. The incident has been resolved; the full update timeline is below.

Started
May 29, 2025, 03:03 AM UTC
Resolved
May 29, 2025, 04:38 AM UTC
Duration
1h 34m
Detected by Pingoru
May 29, 2025, 03:03 AM UTC

Affected components

Wasabi Account Control APIWasabi Account Control Manager Console

Update timeline

  1. investigating May 29, 2025, 03:03 AM UTC

    We are currently investigating System errors when users try to use WACM/Wasabi Account Control API to create subaccounts resulting in Internal Error result.

  2. investigating May 29, 2025, 03:13 AM UTC

    We are continuing to investigate this issue.

  3. identified May 29, 2025, 03:31 AM UTC

    The issue has been identified and a fix is being implemented.

  4. monitoring May 29, 2025, 03:48 AM UTC

    We identified the cause and fixed the issue. The WACM and WAC API are back to normal and no errors should occur now. We will continue monitoring the System status.

  5. resolved May 29, 2025, 04:38 AM UTC

    The WACM/WAC API service is back to normal and we are marking the event as resolved. Once the analysis is completed by our internal team, we will update the status page with the Post Mortem information.

  6. postmortem Jun 02, 2025, 02:12 PM UTC

    On 28 May 2025 at 19:00 UTC, our Engineering and Operations Teams began investigating subaccount creation failures occurring within our WACM/WAC API services. These failures resulted in an HTTP 5XX response error when clients requested the creation of a subaccount utilizing the API or WACM UI. Upon investigation, it was found that a recently deployed software update was responsible for these errors from a bug which caused the API to be unable to reach an internal service due to query timeouts. Once the bug was discovered, our Engineering Team adjusted an internal parameter, allowing API requests to succeed properly. On 29 May 2025 at 03:30 UTC, the WACM/WAC API services were returned back to normal operation.