Kaltura incident

Caption Delays

Minor Resolved View vendor source →

Kaltura experienced a minor incident on December 2, 2022 affecting Processing Speed, lasting 18d 15h. The incident has been resolved; the full update timeline is below.

Started
Dec 02, 2022, 07:33 PM UTC
Resolved
Dec 21, 2022, 10:44 AM UTC
Duration
18d 15h
Detected by Pingoru
Dec 02, 2022, 07:33 PM UTC

Affected components

Processing Speed

Update timeline

  1. investigating Dec 02, 2022, 07:33 PM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Our team is investigating an issue with closed captions and working to resolve it as quickly as possible. What to Expect: The next update will be posted within 1 hour.

  2. investigating Dec 02, 2022, 08:34 PM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current status- Vendor's Engineering team is in the progress of investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 1 hour.

  3. investigating Dec 02, 2022, 09:36 PM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 1 hour.

  4. investigating Dec 02, 2022, 10:36 PM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is currently investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 2 hours.

  5. investigating Dec 03, 2022, 12:34 AM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is currently investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 2 hours.

  6. investigating Dec 03, 2022, 02:46 AM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is still investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 2 hours.

  7. investigating Dec 03, 2022, 04:47 AM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is still investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in 2 hours.

  8. investigating Dec 03, 2022, 08:05 AM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is still investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in next coming hours.

  9. investigating Dec 04, 2022, 05:07 AM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: Vendor's Engineering team is still investigating this issue and analyzing the captions delay. What to Expect: The next update will be provided in upcoming hours.

  10. identified Dec 04, 2022, 05:54 PM UTC

    What is the Issue: Users may experience delays with processing closed captions. Current Status: The vendor confirmed that the process and the caption flow is back to work normally, and we have tested some requests to monitor the results. At this stage, our engineering team is working with the vendor to re-generate the failed requests since Dec 1st. Next update regarding the re-generate process status will be posted by the end of the day (EST) Monday Dec 5th

  11. monitoring Dec 05, 2022, 12:39 PM UTC

    What was the Issue: Users may have experienced delays with processing closed captions. Current Status: The Caption vendor identified the root cause of the issue, the failure mainly happened with YouTube Captions due to recent changes. The Caption Vendor confirmed that the issue was resolved after they deployed a hotfix earlier this morning, the process and the caption flow are back to working normally, and we have tested some requests to monitor the results. At this stage, our team started to re-generate all the failed captions requests since Dec 1st, the process is already in progress and will take a few hours to complete the re-generate of all tasks. What to Expect Next: The issue is resolved, we will keep monitoring the caption flow during the next few hours.

  12. resolved Dec 21, 2022, 10:44 AM UTC

    This incident has been resolved.