Coveo Cloud Outage History

The issue has relapsed and is now occurring again for a subset of customers in the Australia region. Our team is investigating.

We've now confirmed that the issues are caused by a problem which has been acknowledged by one of our infrastructure providers. Although a capacity increase appeared to momentarily resolve the issues, we are now seeing intermittent errors again. For now this means the outage is partial and we are continuing to look at potential mitigation actions.

The incident with our infrastructure provider is still ongoing. In an attempt to decrease the load on the infrastructure we have temporarily paused analytics data processing workflows in this region. This improves the success rate of queries being made against the service at the cost of a delay in the freshness of the data. We will continue to provide updates until solved.

We are continuing to work on a fix for this issue.

The incident is being mitigated by our cloud infrastructure provider. We are seeing recovery with most queries now being successful. Analytics data processing has been resumed, though over the course of this incident we accumulated a backlog that will need to be processed. Dashboards and reports are available again but the data they display may not be up to date.

We've identified an issue affecting the Generative Answering service. A small subset of customers using this service are currently being impacted by elevated error rates, but the majority of queries are continuing to be answered normally. Our team is investigating and will post regular updates until solved. If you need help or to get in touch with us, please visit our Help Portal

We are continuing to work on this issue. Error rates are declining, but a small subset of customers are still impacted.

We've identified an issue causing refresh delays in our European hosting region. Your content might not be up to date. Our team is working on it and will post updates until solved. If you need help or to get in touch with us, please visit our Help Portal

We identified an issue affecting indexing pipeline extensions. Attempting to add extensions to sources is currently not working. Extensions that were already associated with a source are not affected. Our team is actively working on a fix and will post regular updates until solved. If you need help or to get in touch with us, please visit our Help Portal

Our team has identified a workaround: after adding an extension the page will go blank. However, clicking the "Common" tab will successfully display the extension and allow users to save the configuration. Our team is working on rolling out a permanent fix for this issue.

We've identified an issue affecting the latest versions of Atomic, Headless and Atomic React. Customers using these resources in their implementations might notice failures or unexpected behaviors: https://static.cloud.coveo.com/atomic/v3/* https://static.cloud.coveo.com/headless/v3/* https://static.cloud.coveo.com/atomic/v3.4/* https://static.cloud.coveo.com/headless/v3.4/* https://static.cloud.coveo.com/atomic-react/v3/* https://static.cloud.coveo.com/atomic-react/v3.1/* Our team is currently working on deploying a fix. If you need help or to get in touch with us, please visit our Help Portal

An incident with one of our cloud providers is causing data processing to be delayed in the systems powering the Coveo Experimentation Hub (CEH) and Coveo Experience Hub (CXH). Data collection is unaffected and no data is currently being lost - we expect to catch up once our cloud provider has resolved their incident. Experience & Campaign execution on-site is unaffected. Reporting in the administration interfaces of CEH and CXH is currently out of date but still available.

Due to an ongoing database upgrade, security provider refresh operations are temporarily disabled. Your existing security identities and ongoing refresh operations were not affected, but new refreshes will be queued for processing and picked up after the upgrade is complete. We expect these operations to be paused for approximately 60 minutes. If you need help or to get in touch with us, please visit our Help Portal

We've identified an issue affecting some of the Semantic Search Machine Learning models in all the regions. Our team will post regular updates until solved. If you need help or to get in touch with us, please visit our Help Portal

We have identified the root cause and begun rebuilding the subset of affected models. We will give another update once all the impacted models are rebuilt.

Affected models are done rebuilding in the Australian and Canadian hosting regions. Some models in the US and European hosting regions are still undergoing rebuilds.

We are following the issue closely with our infrastructure provider.

Commerce advanced dashboards are showing limited historical data due to a data processing issue. We have identified the issue and are in the process of resolving it.