Highspot incident

Video Processing Issue in AMERICAS Data Centers

Minor Resolved View vendor source →

Highspot experienced a minor incident on December 7, 2021 affecting Content and Content, lasting 3h 39m. The incident has been resolved; the full update timeline is below.

Started
Dec 07, 2021, 09:02 PM UTC
Resolved
Dec 08, 2021, 12:41 AM UTC
Duration
3h 39m
Detected by Pingoru
Dec 07, 2021, 09:02 PM UTC

Affected components

ContentContent

Update timeline

  1. investigating Dec 07, 2021, 09:02 PM UTC

    We are aware of video processing delays affecting customers in AMERICAS data centers. This is likely related to an ongoing issue today at AWS (https://status.aws.amazon.com/). Our engineers are working to confirm the root cause of the issues and identify possible workarounds.

  2. identified Dec 07, 2021, 10:41 PM UTC

    Our engineers and AWS support team have identified the likely root cause of video processing delays in AMERICAS data centers as a side-effect of an ongoing issue today at AWS (https://status.aws.amazon.com/). As AWS progresses toward a resolution, we will continue to monitor video processing jobs. Customers need not take any action as we will automatically retry failed video processing jobs as soon as processing pipelines are back online.

  3. monitoring Dec 07, 2021, 11:30 PM UTC

    Video processing pipelines have been restored and we are observing that queued jobs for video content are processing successfully, though customers may continue to experience delays as our queues catch up. We will continue to monitor closely for any further delays or failures.

  4. resolved Dec 08, 2021, 12:41 AM UTC

    This incident is resolved.