api.video incident

Delivery issue

Major Resolved View vendor source →

api.video experienced a major incident on February 1, 2021 affecting Video On Demand, lasting 7h 23m. The incident has been resolved; the full update timeline is below.

Started
Feb 01, 2021, 02:49 PM UTC
Resolved
Feb 01, 2021, 10:13 PM UTC
Duration
7h 23m
Detected by Pingoru
Feb 01, 2021, 02:49 PM UTC

Affected components

Video On Demand

Update timeline

  1. investigating Feb 01, 2021, 02:49 PM UTC

    We are having problems with the delivery of assets today. Our teams are actively working to resolve the problem.

  2. identified Feb 01, 2021, 07:57 PM UTC

    We are migrating private assets management from the legacy database ETCD(a distributed key-value store) to a Postgresql+Redis databases due to a RPC connectivity issue between our different web-services and ETCD servers. The changes are almost ready to go into production.

  3. monitoring Feb 01, 2021, 08:47 PM UTC

    The fix has been implemented, deployed in production and we are monitoring the result and the stability of the whole platform. We apologize to all our customers for the disagreement.

  4. resolved Feb 01, 2021, 10:13 PM UTC

    This incident has been resolved.