Travis CI incident

Unreliable or intermittent network connectivity for Linux and Windows builds

Major Resolved View vendor source →

Travis CI experienced a major incident on August 6, 2019 affecting Linux and Windows Builds, lasting 20h 45m. The incident has been resolved; the full update timeline is below.

Started
Aug 06, 2019, 05:55 PM UTC
Resolved
Aug 07, 2019, 02:40 PM UTC
Duration
20h 45m
Detected by Pingoru
Aug 06, 2019, 05:55 PM UTC

Affected components

Linux and Windows Builds

Update timeline

  1. investigating Aug 06, 2019, 05:55 PM UTC

    We are receiving reports of Linux and Windows builds where network connectivity is unreliable, intermittently working or slow. We are opening this incident to acknowledge the issue and also keep you posted on our work to solve it. Thank you for your patience.

  2. investigating Aug 06, 2019, 05:55 PM UTC

    We are continuing to investigate this issue.

  3. identified Aug 07, 2019, 07:54 AM UTC

    We've identified an issue with the latest changes to update the NAT gateways. While this change was meant to improve maintainability, we are rolling it back due to the degraded network performance. We're expecting this provides network speed improvements within the next hour. We will provide additional updates at the top of the hour. Thank you

  4. identified Aug 07, 2019, 10:37 AM UTC

    At this point, we've reverted half of the NAT gateway updates and a 50% of the Linux and Windows jobs currently processed have better network performance already. We'll provide another update as soon as this process is complete. Thanks for your patience.

  5. monitoring Aug 07, 2019, 12:38 PM UTC

    The NAT gateway changes have been fully reverted. Network performance and reliability in your builds should be back to normal. We’ll be monitoring for a short while before closing this incident.

  6. resolved Aug 07, 2019, 02:40 PM UTC

    This incident has been resolved.