CxAlloy incident

Image Previews Failing Intermittently

Minor Resolved View vendor source →

CxAlloy experienced a minor incident on April 24, 2020 affecting Photos and File Previews, lasting 2d 13h. The incident has been resolved; the full update timeline is below.

Started
Apr 24, 2020, 05:39 PM UTC
Resolved
Apr 27, 2020, 06:45 AM UTC
Duration
2d 13h
Detected by Pingoru
Apr 24, 2020, 05:39 PM UTC

Affected components

Photos and File Previews

Update timeline

  1. identified Apr 24, 2020, 05:39 PM UTC

    Starting Thursday afternoon we observed intermittent issues with image thumbnails and previews not rendering. The source of the issue is the 3rd-party service we use for image resizing, which started to give connection timeouts when our servers requested resized images. We were able to resolve the issue with image thumbnails by moving the image requests from our server to the browser. In addition, we immediately contacted our 3rd-party provider and we are continuing to work with them on resolving the connection timeouts that are the root of the issue. Image previews (the larger image view seen when clicking on an image) may not render while we work to resolve this issue. We will continue to update on our progress in resolving this.

  2. resolved Apr 28, 2020, 08:59 PM UTC

    On Monday we rolled out an update that removed our dependence on the 3rd-party image rendering service for our larger image previews, as our provider has not been able to resolve the connection timeouts in a timely manner. This incident is resolved.