Clarifai experienced a critical incident on April 21, 2021 affecting Apparel Model and Custom Training and 1 more component, lasting 12h 28m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Apr 21, 2021, 01:57 PM UTC
We are currently investigating this issue.
- identified Apr 21, 2021, 01:57 PM UTC
The issue has been identified and a fix is being implemented.
- identified Apr 21, 2021, 03:17 PM UTC
We are working through a database issue that is affecting all queries.
- identified Apr 21, 2021, 04:08 PM UTC
At 6:30 am EDT, we experienced an outage on a database node as a result of an automated failover on a redundant node. This outage is affecting all customers and is currently preventing write and search operations on our cloud platform. All prediction operations continue to function normally. Our team is working diligently with our service provider to restore service. In the meantime, we will continue to keep you updated as we restore our systems. We understand the impact this is potentially having on some customers. Please be assured we are doing everything within our power to resolve this incident as soon as possible.
- identified Apr 21, 2021, 04:22 PM UTC
We are continuing to work on a fix for this issue.
- identified Apr 21, 2021, 04:24 PM UTC
We are continuing to work on a fix for this issue.
- monitoring Apr 22, 2021, 02:24 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Apr 22, 2021, 02:26 AM UTC
This incident has been resolved.