OpenWater incident

Intermittent Performance Degradation

Minor Resolved View vendor source →

OpenWater experienced a minor incident on November 12, 2015, lasting 20h 40m. The incident has been resolved; the full update timeline is below.

Started
Nov 12, 2015, 05:50 PM UTC
Resolved
Nov 13, 2015, 02:31 PM UTC
Duration
20h 40m
Detected by Pingoru
Nov 12, 2015, 05:50 PM UTC

Update timeline

  1. investigating Nov 12, 2015, 05:50 PM UTC

    We have been investigating for the past hour the cause of degraded performance in one of our nodes. Some customers may be experiencing downtime, while other customers are not. We are working on this issue to and will provide updates when a resolution is in place.

  2. investigating Nov 12, 2015, 06:37 PM UTC

    Quick update: We still have one bad node so intermittent slow speeds or time outs may occur. Continuing to work on the issue.

  3. identified Nov 12, 2015, 07:55 PM UTC

    We have identified the bad node and are working with our service provider to remove it.

  4. identified Nov 12, 2015, 10:26 PM UTC

    Most customers instances have been mitigated. Still working with Microsoft to resolve remaining customers.

  5. monitoring Nov 12, 2015, 10:55 PM UTC

    All customers have now been mitigated. We are monitoring carefully.

  6. resolved Nov 13, 2015, 02:31 PM UTC

    Fully resolved now.