Resi Media incident

Cloud storage latency (GCS)

Major Resolved View vendor source →

Resi Media experienced a major incident on February 2, 2021 affecting Network infrastructure (3rd party), lasting 15m. The incident has been resolved; the full update timeline is below.

Started
Feb 02, 2021, 02:00 AM UTC
Resolved
Feb 02, 2021, 02:15 AM UTC
Duration
15m
Detected by Pingoru
Feb 02, 2021, 02:00 AM UTC

Affected components

Network infrastructure (3rd party)

Update timeline

  1. monitoring Feb 02, 2021, 02:00 AM UTC

    Starting at 6:54pm CST, the Resi engineering team was automatically alerted to intermittent high latency from our services - including our Cloud Transcoder - to Google Cloud Storage (GCS) in North America. This triggered read timeouts while downloading files from GCS and resulted in some web streams in North America failing to start up or beginning to fall behind. Web streams in regions outside North America were not impacted. At 7:08pm CST, latency to GCS in the North America returned to normal. We are closely monitoring performance and are working with Google to understand the root cause of the problem.

  2. resolved Feb 03, 2021, 04:43 PM UTC

    This incident has been resolved.