Staffbase incident

[App/Intranet] - Long Loading times on our German System

Minor Resolved View vendor source →

Staffbase experienced a minor incident on March 11, 2025 affecting Core API (Europe) [SLA], lasting 1d 2h. The incident has been resolved; the full update timeline is below.

Started
Mar 11, 2025, 10:06 AM UTC
Resolved
Mar 12, 2025, 12:47 PM UTC
Duration
1d 2h
Detected by Pingoru
Mar 11, 2025, 10:06 AM UTC

Affected components

Core API (Europe) [SLA]

Update timeline

  1. investigating Mar 11, 2025, 10:06 AM UTC

    Some customers on our German system may be experiencing slower loading times. Our teams are actively investigating the issue. We will provide updates as soon as we have more information. You can see on which system your application is hosted by going to the Studio > Settings > API Access and checking the tag next to the title. We apologize for the interruption. In case you have any questions about this topic, please let us know at [email protected].

  2. monitoring Mar 11, 2025, 01:06 PM UTC

    We have made backend adjustments to resolve this issue. We will continue to monitor the systems until we are sure the issue is fully resolved.

  3. investigating Mar 12, 2025, 07:12 AM UTC

    Some customers on our German system may be experiencing slower loading times. Our teams are actively investigating the issue. We will provide updates as soon as we have more information. We apologize for the inconvenience. If you have any questions regarding this topic, please reach out to our support at [email protected].

  4. monitoring Mar 12, 2025, 08:43 AM UTC

    Performance has stabilized. We will continue to monitor the situation and update you shortly.

  5. resolved Mar 12, 2025, 12:47 PM UTC

    This incident has been resolved. We are sorry for the trouble this has caused. Please contact us at [email protected] should you experience any further issues. We’re happy to help!

  6. postmortem Mar 18, 2025, 01:42 PM UTC

    **Summary:** Our investigation of the incident is now complete, and we would like to share more details about the issue that occurred between March 11, 10:40 CET, and March 12, 13:47 CET. ‌ **What happened:** System checks for certain features caused the backend to slow down. ‌ **Impact:** During the mentioned period, users on the German server experienced longer loading times when accessing app or intranet. ‌ **Future Improvements:** We have optimized backend metric queries for auto-scaling and reduced the number of system checks. Additionally, we have implemented extra tests to prevent similar issues in the future. Please contact us at [[email protected]](mailto:[email protected]) if you have any further questions regarding this topic or if any feature is still impacted against our expectations.