Ekklesia 360 incident

Heavy Load to CMS

Major Resolved View vendor source →

Ekklesia 360 experienced a major incident on September 21, 2019 affecting Site Hosting: Cloud and Site Hosting: The Abbey and 1 more component, lasting 18h 28m. The incident has been resolved; the full update timeline is below.

Started
Sep 21, 2019, 02:28 AM UTC
Resolved
Sep 21, 2019, 08:56 PM UTC
Duration
18h 28m
Detected by Pingoru
Sep 21, 2019, 02:28 AM UTC

Affected components

Site Hosting: CloudSite Hosting: The AbbeySite Hosting: One-Click (Decommissioned)CMS BackendSSL

Update timeline

  1. investigating Sep 21, 2019, 02:28 AM UTC

    We are currently experiencing unusually high levels of requests to our servers and as a result, have temporarily turned off access to the backend editing of the CMS. Your websites are still online and should not be impacted at this time, but form submissions, and event RSVPs may result in errors at this time.

  2. investigating Sep 21, 2019, 02:44 AM UTC

    We are continuing to investigate the issue and have disabled form submissions and event RSVPs at this time.

  3. investigating Sep 21, 2019, 03:25 AM UTC

    We are continuing to investigate the heavy load our system was receiving and will post another update in 30 minutes. At this time your website is online but form, newsletter, and event RSVP submissions are not being stored.

  4. monitoring Sep 21, 2019, 03:49 AM UTC

    We have re-enabled access to all services and will continue to monitor the servers for any further degradation.

  5. resolved Sep 21, 2019, 08:56 PM UTC

    After continued monitoring, we are resolving all issues that occurred yesterday.