Kontent.ai incident

Delivery & Preview API outage affecting US data center

Major Resolved View vendor source →

Kontent.ai experienced a major incident on April 6, 2023 affecting Delivery REST API and Delivery GraphQL API and 1 more component, lasting 17h 27m. The incident has been resolved; the full update timeline is below.

Started
Apr 06, 2023, 03:18 PM UTC
Resolved
Apr 07, 2023, 08:45 AM UTC
Duration
17h 27m
Detected by Pingoru
Apr 06, 2023, 03:18 PM UTC

Affected components

Delivery REST APIDelivery GraphQL APIWebhook dispatcher

Update timeline

  1. investigating Apr 06, 2023, 03:18 PM UTC

    We are aware of an issue causing both preview and delivery APIs to not deliver updated content. We are currently working to identify the cause.

  2. investigating Apr 06, 2023, 03:34 PM UTC

    After testing this appears to be affecting graphQL as well

  3. investigating Apr 06, 2023, 03:35 PM UTC

    We are continuing to investigate this issue.

  4. investigating Apr 06, 2023, 04:34 PM UTC

    The issue is also causing webhook notifications for content changes not to be sent.

  5. identified Apr 06, 2023, 06:29 PM UTC

    We have identified the cause of the outage in our system, which was related to our backend service provider. We're actively working with them to resolve the issue as quickly as possible. Our team is working diligently to get everything back up and running smoothly, and we'll provide updates as soon as we have more information. We appreciate your patience and understanding.

  6. monitoring Apr 06, 2023, 08:40 PM UTC

    We have found a solution and put a fix in place which has restored Delivery API functionality. Content changes made during the outage may still take longer than anticipated to be reflected due to the time it will take to process the accumulated traffic. We will continue to monitor the situation and provide an update when we feel confident the issue is totally resolved. Thank you for your patience and understanding.

  7. resolved Apr 07, 2023, 08:45 AM UTC

    After a few hours of monitoring, all of our services work as expected.