SiteSpect incident

SiteSpect Cloud - Reduced Points of Presence Availability

Major Resolved View vendor source →

SiteSpect experienced a major incident on October 9, 2018 affecting AMS - Amsterdam, Netherlands and NYJ - Secaucus, NJ, United States and 1 more component, lasting 12h 23m. The incident has been resolved; the full update timeline is below.

Started
Oct 09, 2018, 03:39 PM UTC
Resolved
Oct 10, 2018, 04:03 AM UTC
Duration
12h 23m
Detected by Pingoru
Oct 09, 2018, 03:39 PM UTC

Affected components

AMS - Amsterdam, NetherlandsNYJ - Secaucus, NJ, United StatesLON I - London, United KingdomATL - Atlanta, GA, United StatesLON II - London, United KingdomCHG - Chicago, IL, United StatesDAL - Dallas, TX, United StatesSJE - San Jose, CA, United StatesLAX - Los Angeles, CA, United States

Update timeline

  1. investigating Oct 09, 2018, 03:39 PM UTC

    We are actively investigating a possible Cloud-wide incident. We will post an update as soon as we have more information or within 30 minutes.

  2. investigating Oct 09, 2018, 03:40 PM UTC

    We are continuing to investigate this issue.

  3. investigating Oct 09, 2018, 04:05 PM UTC

    At 11:57 PM ET, we have proactively bypassed the SiteSpect Cloud. This means that your site traffic is not routing through SiteSpect and routes directly to your origin. Please note that the campaigns that are active on SiteSpect are currently not being served on your site. Our engineers continue to investigate and we will post another update in 30 minutes.

  4. identified Oct 09, 2018, 04:57 PM UTC

    SiteSpect engineers have identified the issue and understand the root cause. We have taken steps to ensure stability and are in the process of restoring Cloud traffic in a phased approach.

  5. monitoring Oct 09, 2018, 05:42 PM UTC

    SiteSpect engineers are in the process of removing bypass slowly and safely. You should see traffic ramping up through SiteSpect Cloud. We are monitoring the infrastructure closely as we continue the un-bypass process.

  6. monitoring Oct 09, 2018, 06:59 PM UTC

    SiteSpect engineers have restored traffic through the Cloud. We will continue to monitor our systems closely. Please reach out to us at [email protected] if you have further questions.

  7. monitoring Oct 09, 2018, 07:11 PM UTC

    SiteSpect engineers have restored traffic through the Cloud. We will continue to monitor our systems closely. Please reach out to us at [email protected] if you have further questions.

  8. resolved Oct 10, 2018, 04:03 AM UTC

    This incident has been resolved.