Where's it Up incident

Increased packet loss

Major Resolved View vendor source →

Where's it Up experienced a major incident on February 16, 2020 affecting Job Submission and Demo and 1 more component, lasting 22h 9m. The incident has been resolved; the full update timeline is below.

Started
Feb 16, 2020, 05:50 PM UTC
Resolved
Feb 17, 2020, 04:00 PM UTC
Duration
22h 9m
Detected by Pingoru
Feb 16, 2020, 05:50 PM UTC

Affected components

Job SubmissionDemoJob RetrievalAccount Management

Update timeline

  1. investigating Feb 16, 2020, 05:50 PM UTC

    We're currently experiencing high packet loss, we're investigating. Users will see reduced performance during this incident.

  2. investigating Feb 16, 2020, 05:51 PM UTC

    Proxy servers are unaffected, but account management functions may be slower.

  3. monitoring Feb 16, 2020, 06:10 PM UTC

    We've implemented a fix and are monitoring the situation.

  4. identified Feb 16, 2020, 08:19 PM UTC

    We're experiencing connectivity loss with our website. We're working with our host to deploy a fix. Proxy servers remain unaffected though users are not able to make changes to their account at this time.

  5. identified Feb 16, 2020, 10:45 PM UTC

    We are continuing to work on a fix for this issue.

  6. identified Feb 17, 2020, 02:15 AM UTC

    We are continuing to work on a fix for this issue.

  7. resolved Feb 26, 2020, 04:00 PM UTC

    This incident has been resolved.