Seeking Alpha incident

RAM upgrades on 3 servers

Major Resolved View vendor source →

Seeking Alpha experienced a major incident on September 12, 2014, lasting 9h 2m. The incident has been resolved; the full update timeline is below.

Started
Sep 12, 2014, 03:24 PM UTC
Resolved
Sep 13, 2014, 12:26 AM UTC
Duration
9h 2m
Detected by Pingoru
Sep 12, 2014, 03:24 PM UTC

Update timeline

  1. scheduled Sep 12, 2014, 03:24 PM UTC

    The main multi prod node will be upgraded, that will effect spell checking and a few other minor items. The other 2 server - Redis will be done with no effect to the site.

  2. in progress Sep 12, 2014, 10:20 PM UTC

    Starting with multi prod RAM upgrade. Some items will be affected like spell checker. And some transnational emails.

  3. in progress Sep 12, 2014, 10:24 PM UTC

    Comment submission is also affected by lack of main email server.

  4. in progress Sep 12, 2014, 10:36 PM UTC

    All should be back online now

  5. in progress Sep 12, 2014, 10:51 PM UTC

    The Redis upgrade is causing some random issues. We are restarting the apps to try to resolve it.

  6. monitoring Sep 13, 2014, 12:10 AM UTC

    I think we are done. Monitoring a little.

  7. completed Sep 13, 2014, 12:26 AM UTC

    Done. All systems looking good.