Resi Media incident

A small number of encoders are having their connection reset by peer when downloading/uploading files to the cloud

Major Resolved View vendor source →

Resi Media experienced a major incident on April 10, 2022 affecting Network infrastructure (3rd party), lasting 5h 6m. The incident has been resolved; the full update timeline is below.

Started
Apr 10, 2022, 02:29 PM UTC
Resolved
Apr 10, 2022, 07:35 PM UTC
Duration
5h 6m
Detected by Pingoru
Apr 10, 2022, 02:29 PM UTC

Affected components

Network infrastructure (3rd party)

Update timeline

  1. investigating Apr 10, 2022, 02:29 PM UTC

    We are currently investigating an issue where small number encoders are having their connection reset by peer when downloading/uploading files to GCS buckets. This means that some encoders are not able to stream any content. Our engineering team is currently investigating the issue.

  2. identified Apr 10, 2022, 06:06 PM UTC

    The issue is now understood that certain firewalls are blocking requests to Google Cloud Platform. This means the issue is not related to Resi hardware, but rather the network the encoder from which the encoder is communicating. The evidence suggests this is likely due to a change in the Google SSL certificate for HTTPS requests to https://storage.googleapis.com

  3. resolved Apr 10, 2022, 07:35 PM UTC

    This issue is being downgraded from an incident since the issue appears to be isolated to SonicWall firewalls blocking requests to GCS (https://storage.googleapis.com) after mistakenly being marked as a potential threat. If you are experiencing this issue and are also a user of SonicWall, we would recommend creating a ticket with your managed service provider for a resolution to this issue. If you believe you are experiencing a similar issue related to this incident and are not a user of SonicWall, please reach out to [email protected].