4Schools incident

SEEDS (IEP4Schools) performance issues

Major Resolved View vendor source →

4Schools experienced a major incident on May 13, 2024 affecting Application, lasting 1d 12h. The incident has been resolved; the full update timeline is below.

Started
May 13, 2024, 01:15 AM UTC
Resolved
May 14, 2024, 01:31 PM UTC
Duration
1d 12h
Detected by Pingoru
May 13, 2024, 01:15 AM UTC

Affected components

Application

Update timeline

  1. identified May 13, 2024, 01:15 AM UTC

    We are currently seeing slow performance on SEEDS after recent maintenance. We have identified the cause, and have a development team actively working to resolve it.

  2. monitoring May 13, 2024, 04:13 AM UTC

    Our development team has implemented a fix for the problem. In our tests, SEEDS is now operating as fast as ever. Due to the low traffic pattern at this hour, we are holding in *Monitoring* status to be sure performance improves under load.

  3. identified May 13, 2024, 12:10 PM UTC

    Once SEEDS traffic ramped up this morning, we identified another spot that needs to be optimized. Our developers are caffeinated and working on a fix now.

  4. identified May 13, 2024, 12:36 PM UTC

    SEEDS is being paused again to free up resources to allow our developers to continue fixing this performance issue

  5. monitoring May 13, 2024, 01:29 PM UTC

    Our dev team has completed another round of optimizations, and SEEDS is back open. We are keeping an eye on things to be sure we caught the last gremlin.

  6. monitoring May 13, 2024, 09:01 PM UTC

    As we closely watched SEEDS performance today, performance has been great since 8:30! Shortly, our developers are publishing one small release to fix some bugs affecting some menus and forms. Our team is still focused on SEEDS stability and remains in Monitoring status as these fixes get pushed out.

  7. resolved May 14, 2024, 01:31 PM UTC

    SEEDS has continued to perform well after last night's updates. This issue is resolved!