Rainforest QA incident

Virtual machine connectivity issues

Minor Resolved View vendor source →

Rainforest QA experienced a minor incident on July 20, 2022 affecting Rainforest and Tester Portal, lasting 12h 29m. The incident has been resolved; the full update timeline is below.

Started
Jul 20, 2022, 07:22 PM UTC
Resolved
Jul 21, 2022, 07:52 AM UTC
Duration
12h 29m
Detected by Pingoru
Jul 20, 2022, 07:22 PM UTC

Affected components

RainforestTester Portal

Update timeline

  1. investigating Jul 20, 2022, 07:22 PM UTC

    We are seeing elevated rates of errors related to network connectivity from our Virtual Machine infrastructure and are investigating.

  2. monitoring Jul 20, 2022, 07:43 PM UTC

    We've identified the problem as an issue with one of our upstream hosting providers. Network connectivity appears to be improving and we are seeing fewer errors, but we will continue to monitor the situation.

  3. monitoring Jul 20, 2022, 10:42 PM UTC

    Our upstream provider is working to resolve these networking issues, but we are still seeing periodic network connectivity issues within our virtual machine infrastructure. We'll continue to monitor the situation.

  4. resolved Jul 21, 2022, 07:52 AM UTC

    Our upstream provider has resolved these networking issues. We are no longer seeing any issues on our end.