Digital Pigeon incident

Issue uploading and downloading files for some accounts

Minor Resolved View vendor source →

Digital Pigeon experienced a minor incident on December 9, 2016, lasting 19h 41m. The incident has been resolved; the full update timeline is below.

Started
Dec 09, 2016, 12:51 AM UTC
Resolved
Dec 09, 2016, 08:33 PM UTC
Duration
19h 41m
Detected by Pingoru
Dec 09, 2016, 12:51 AM UTC

Update timeline

  1. investigating Dec 09, 2016, 12:51 AM UTC

    We are currently investigating issues uploading and downloading files.

  2. identified Dec 09, 2016, 01:16 AM UTC

    There appears to be a global Amazon AWS issue that is effecting all uploads and downloads that utilise the 'Cloudfront optimized routes' feature. We are working to mitigate the issue...

  3. identified Dec 09, 2016, 01:21 AM UTC

    We are working with Amazon AWS engineers to resolve the issue. A work-around will be available within the hour.

  4. identified Dec 09, 2016, 01:56 AM UTC

    We are currently deploying an emergency work-around to mitigate the issue. ETA 5 minutes...

  5. identified Dec 09, 2016, 02:06 AM UTC

    The work-around is now live. For the work-around to take effect you will need to cancel and restart your upload.

  6. monitoring Dec 09, 2016, 02:11 AM UTC

    A fix has been implemented and we are monitoring the results.

  7. resolved Dec 09, 2016, 08:33 PM UTC

    Amazon AWS has resolved the issue with 'Cloudfront Optimized Routes' and we have reverted the temporary work-around. You may need to cancel and re-start uploads for the fix to take effect.