Sitejet incident

System Overload

Resolved after 4 hours 55 minutes, affecting Website Editor and Customer Portal and 1 more, on February 22, 2023.

postmortem Feb 22, 2023, 05:56 PM UTC

Through an attack against our e-mail infrastructure we experienced a chain reaction that ultimately also resulted in the Sitejet application becoming partially unusable. For example, changes could not be saved or the app did not open at all at times. Also e-mails were delivered with a delay. We apologize very much for the inconvenience caused and take the situation very seriously. After a thorough investigation, we will take several measures in the next few days to prevent such a problem in the future: * Better protection against attacks on our email infrastructure * Smart balancing of \(internal\) traffic to prevent chain reactions * Improve email processing performance

Started
Feb 22, 2023, 01:00 PM UTC
Resolved
Feb 22, 2023, 05:56 PM UTC
Duration
4h 55m
Detected by Pingoru
Feb 22, 2023, 01:00 PM UTC

Affected components

Website EditorCustomer PortalAPIProject Management

Update timeline

  1. investigating Feb 22, 2023, 01:09 PM UTC

    We are currently investigating this issue.

  2. investigating Feb 22, 2023, 01:14 PM UTC

    We are continuing to investigate this issue.

  3. investigating Feb 22, 2023, 01:29 PM UTC

    We are continuing to investigate this issue.

  4. monitoring Feb 22, 2023, 02:19 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Feb 22, 2023, 05:56 PM UTC

    This incident has been resolved.

  6. postmortem Feb 22, 2023, 05:56 PM UTC

    Through an attack against our e-mail infrastructure we experienced a chain reaction that ultimately also resulted in the Sitejet application becoming partially unusable. For example, changes could not be saved or the app did not open at all at times. Also e-mails were delivered with a delay. We apologize very much for the inconvenience caused and take the situation very seriously. After a thorough investigation, we will take several measures in the next few days to prevent such a problem in the future: * Better protection against attacks on our email infrastructure * Smart balancing of \(internal\) traffic to prevent chain reactions * Improve email processing performance

Your product runs on more than Sitejet

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →