Coveo HIPAA experienced a major incident on April 12, 2023 affecting Coveo ML - Models Generator, lasting 8h 20m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Apr 12, 2023, 06:56 PM UTC
We've identified an issue affecting Machine Learning model building. Model building is currently disabled and a subset of models that were rebuilt since April 11, 17h EDT might return results based on data outside of the specified range. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our Help Portal
- identified Apr 12, 2023, 08:14 PM UTC
The cause of the issue has been identified and a fix is being implemented. Thank you for your patience. If you need help or to get in touch with us, please visit our Help Portal
- monitoring Apr 12, 2023, 11:21 PM UTC
A fix has been implemented and the affected models are starting to be rebuilt. We will continue to monitor the service until this process is completed, but we expect several hours of delay for all rebuilds currently queued to be processed.
- resolved Apr 13, 2023, 03:16 AM UTC
All affected models were rebuilt. This incident has been resolved.