Tenfold incident

API - Elevated API Errors

Notice Resolved View vendor source →

Tenfold experienced a notice incident on February 24, 2021 affecting API, lasting 1d 4h. The incident has been resolved; the full update timeline is below.

Started
Feb 24, 2021, 05:57 PM UTC
Resolved
Feb 25, 2021, 10:15 PM UTC
Duration
1d 4h
Detected by Pingoru
Feb 24, 2021, 05:57 PM UTC

Affected components

API

Update timeline

  1. investigating Feb 24, 2021, 05:57 PM UTC

    Tenfold automated systems have detected elevated errors with our API connection. Users may experience issues of intermittent or persistent loss of functionality to Tenfold services. Our team is currently investigating, and we will be providing more information as it is made available. Feel free to subscribe for the most up-to-date notifications here: How to Subscribe

  2. monitoring Feb 24, 2021, 06:22 PM UTC

    As of 11:58 pm CT, API errors have decreased and remain within acceptable range. Tenfold users should expect services to stabilize and return to fully functional state. At this time, engineering has moved towards monitoring the event throughout the remainder of the day and will update this incident with further details as they become known.

  3. resolved Feb 25, 2021, 10:15 PM UTC

    Tenfold engineers have not observed a reoccurrence of this event within the last 24 hours. After conducting a root cause analysis, it has been confirmed that our 3rd party cloud provider had an outage which impacted our real time database during this incident. We will work with our 3rd party provider to explore opportunities to better understand this event improvements.