Astro's Lounge incident

Increased API errors

Resolved after 4 days 14 hours, affecting API and Web Interface and 1 more, on June 9, 2025.

monitoring Jun 13, 2025, 07:51 AM UTC

We have deployed an additional and final patch to resolve a few minor lingering issues that occurred under very specific conditions. We will continue to monitor system performance over the next 24 hours, and if no further issues are observed, this incident will be considered resolved and formally closed.

Started
Jun 09, 2025, 06:24 PM UTC
Resolved
Jun 14, 2025, 08:59 AM UTC
Duration
4d 14h
Detected by Pingoru
Jun 09, 2025, 06:24 PM UTC

Affected components

APIWeb InterfaceConnection Managers/Load BalancersData Processing

Update timeline

  1. investigating Jun 09, 2025, 06:24 PM UTC

    We are currently investigating this issue.

  2. identified Jun 09, 2025, 06:55 PM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Jun 09, 2025, 07:17 PM UTC

    We are currently performing unscheduled maintenance on our API systems to address an issue where connections were not closing properly causing increased API errors after time. This maintenance is necessary to ensure stability and prevent future disruptions. :wrench: What’s affected: - API requests may fail or be delayed - Some features relying on API responses may be degraded Our engineering team is actively rolling out patches and monitoring the process. We appreciate your patience and will provide updates as progress is made.

  4. monitoring Jun 09, 2025, 08:20 PM UTC

    We’ve deployed an update to address the issue with API connections not closing properly. Systems are returning to normal, and we are now actively monitoring to ensure stability and full functionality. We’ll provide a final update once the incident is fully resolved. Thank you for your continued patience.

  5. monitoring Jun 10, 2025, 08:49 PM UTC

    We are continuing to actively monitor the situation to ensure full stability and no reoccurrence of the issue. No additional disruptions have been detected at this time.

  6. monitoring Jun 11, 2025, 06:41 AM UTC

    We are continuing to actively monitor the situation to ensure full stability and no reoccurrence of the issue. No additional disruptions have been detected at this time.

  7. monitoring Jun 11, 2025, 07:38 PM UTC

    We've just deployed an additional patch to further address the API issue affecting connection closures. This follow-up fix was developed after continued monitoring revealed that, under certain conditions, some API connections were not terminating correctly—resulting in performance degradation and increased server load during peak times. With this second patch now in place, our monitoring tools are showing clear improvements in both stability and performance. We are closely monitoring all API-related metrics and logs to ensure the effectiveness of this update under real-world usage. If no further issues are detected, this will represent the final resolution of the incident. Thank you for your continued patience as we worked through this complex issue. Ensuring the reliability and performance of our platform remains our top priority.

  8. monitoring Jun 13, 2025, 07:51 AM UTC

    We have deployed an additional and final patch to resolve a few minor lingering issues that occurred under very specific conditions. We will continue to monitor system performance over the next 24 hours, and if no further issues are observed, this incident will be considered resolved and formally closed.

  9. resolved Jun 14, 2025, 08:59 AM UTC

    This incident has been resolved.

Your product runs on more than Astro's Lounge

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →