Maxio incident

Advanced Billing - API Service Interruption on "Create Usage" Endpoint

Major Resolved View vendor source →

Maxio experienced a major incident on March 31, 2025 affecting API, lasting 30m. The incident has been resolved; the full update timeline is below.

Started
Mar 31, 2025, 10:58 PM UTC
Resolved
Mar 31, 2025, 11:28 PM UTC
Duration
30m
Detected by Pingoru
Mar 31, 2025, 10:58 PM UTC

Affected components

API

Update timeline

  1. identified Mar 31, 2025, 10:58 PM UTC

    We experienced an issue with the Advanced Billing "Create Usage" API endpoint between the 2025-03-31 17:49:38 -0400 and 2025-03-31 18:22:21 -0400, and 2025-03-31 18:42:22 -0400 - 2025-03-31 18:49:36 -0400 where timeouts resulted in 500 errors. This was caused by an unexpected load increase from a separate service, which impacted the performance of the Usage endpoint. The underlying issue has been identified and system performance has stabilized. A full resolution is in progress.

  2. monitoring Mar 31, 2025, 11:24 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Mar 31, 2025, 11:28 PM UTC

    Service has been fully restored, but any usage submissions that received a 500 error during the affected periods will need to be resent. Please reach out to our Support team should you require logs of specific usage API calls that were impacted as we are happy to provide these. We apologize for this disruption. We are implementing improvements to our systems to prevent similar issues in the future. Thank you for your patience and understanding.