Formant incident

Ingestion Service Issue

Critical Resolved View vendor source →

Formant experienced a critical incident on May 10, 2022 affecting Ingestion Pipeline, lasting 9h 21m. The incident has been resolved; the full update timeline is below.

Started
May 10, 2022, 01:32 PM UTC
Resolved
May 10, 2022, 10:54 PM UTC
Duration
9h 21m
Detected by Pingoru
May 10, 2022, 01:32 PM UTC

Affected components

Ingestion Pipeline

Update timeline

  1. investigating May 10, 2022, 01:32 PM UTC

    Our ingestion service is experiencing issues and some workers are blocked. Device Status, Presence, and Formant Data Pipeline are affected .We are looking into it .

  2. identified May 10, 2022, 03:00 PM UTC

    The issue has been identified and a fix is being implemented.

  3. identified May 10, 2022, 05:57 PM UTC

    We are currently facing an outage. We are actively working to fix this. We have identified the issue and our current ETA is to fix it within the next hour (12 PM PT).

  4. monitoring May 10, 2022, 08:17 PM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved May 10, 2022, 10:54 PM UTC

    This incident has been resolved.