Intellistack incident

Firewall Upgrades

Major Resolved View vendor source →

Intellistack experienced a major incident on July 1, 2015, lasting 3d 16h. The incident has been resolved; the full update timeline is below.

Started
Jul 01, 2015, 11:32 AM UTC
Resolved
Jul 05, 2015, 04:25 AM UTC
Duration
3d 16h
Detected by Pingoru
Jul 01, 2015, 11:32 AM UTC

Update timeline

  1. scheduled Jul 01, 2015, 11:32 AM UTC

    We will be replacing our hardware firewall with a pair of upgraded ones to prevent outages that have plagued us this month. Our current firewall is periodically losing packets and is no longer supported by our datacenter.

  2. scheduled Jul 01, 2015, 11:35 AM UTC

    We're still trying to figure out impact, likely less than 5 minutes of downtime (if any).

  3. scheduled Jul 02, 2015, 12:18 PM UTC

    The maintenance should result in no more than 30 minutes of downtime, and will likely be closer to 15 minutes. We're not sure yet when in the 3 hour window the downtime may occur, but we will update this space when it starts.

  4. in progress Jul 05, 2015, 04:10 AM UTC

    The downtime as our Firewall is upgraded has begun. We'll update as it progresses.

  5. monitoring Jul 05, 2015, 04:14 AM UTC

    Formstack is operational again. The maintenance window is still in progress so we're keeping an eye on things until we hear more.

  6. completed Jul 05, 2015, 04:25 AM UTC

    The firewall swap has been completed successfully and the services behind it are online and pinging.