Simplecast incident

Episode Encoding Delays

Notice Resolved View vendor source →

Simplecast experienced a notice incident on April 20, 2017, lasting 2h 33m. The incident has been resolved; the full update timeline is below.

Started
Apr 20, 2017, 01:47 PM UTC
Resolved
Apr 20, 2017, 04:20 PM UTC
Duration
2h 33m
Detected by Pingoru
Apr 20, 2017, 01:47 PM UTC

Update timeline

  1. identified Apr 20, 2017, 01:47 PM UTC

    We are aware of the audio encoding delays currently plaguing certain customers. A fix is being prepared for deployment. Updates shortly.

  2. identified Apr 20, 2017, 02:03 PM UTC

    A fix has been deployed and multiple new encoding servers are being spun up to help us process the queue of newly uploaded episodes. Encoding may still be delayed shortly, but will catch up soon. Will update again shortly.

  3. identified Apr 20, 2017, 02:26 PM UTC

    The encoding fix was successful, we're only now waiting on the backlog of files to encode. We have quadrupled our number of encoding worker nodes to speed up the process. Please note that deleting your pending episode and re-uploading will not speed up the process.

  4. monitoring Apr 20, 2017, 03:19 PM UTC

    Queue and encoding wait times have returned to normal following this mornings incident. To be safe, we are continuing to monitor the situation. Our apologies for the slow encoding times. In our post mortem discussion we will take steps to ensure this rare situation does not arise again.

  5. resolved Apr 20, 2017, 04:20 PM UTC

    For the past 60 minutes all encoding delays and processing queues have remained normal. We are marking today's incident as resolved, but will continue to monitor nonetheless. Thank you again for your patience!