Sigma Computing incident
Degraded Performance on Sigma AWS - Connection Indexing
Sigma Computing experienced a minor incident on June 1, 2023 affecting Sigma - AWS (US), lasting 1d 1h. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jun 01, 2023, 04:47 PM UTC
To mitigate system slowness while we fix the root cause, we temporarily disabled automated connection indexing. Newly-created connections may be slow to navigate and search may not return them. Existing connections may need to have their databases/schemas/tables manually synced in Sigma if changes are made in the warehouse. Impacted Cloud Regions & Services: Sigma users hosted on AWS US, all connection types
- identified Jun 01, 2023, 05:09 PM UTC
We are continuing to work on a fix for this issue.
- identified Jun 01, 2023, 11:52 PM UTC
Current Status: In an effort to resolve the issue, we plan to restart connection indexing services tonight, June 1, between 11PM and midnight PDT. The restart event is expected to complete in under 2 minutes; during this time, workbook loads may fail. Impacted Cloud Regions & Services: Sigma users hosted on AWS US, all connection types User Experience: Up to 2 minute disruption in workbook loads during 11PM-midnight PDT maintenance window. Incident Start Time: June 1st 2023, Approximately 13:00 UTC
- monitoring Jun 02, 2023, 12:16 PM UTC
Current Status: Our engineers have implemented mitigation measures to circumvent the issue and we are monitoring their effect closely. Impacted Cloud Regions & Services: Sigma users hosted on AWS US, all connection types User Experience: As connection indexing has been reenabled, there should no longer be any issue with slow navigation or search of warehouse schema. Incident Start Time: June 1st 2023, Approximately 13:00 UTC Incident End Time: June 2nd, 2023, Approximately 06:40 UTC
- resolved Jun 02, 2023, 06:44 PM UTC
Current Status: The mitigation measures have proven effective, and the issue is resolved. Impacted Cloud Regions & Services: Sigma users hosted on AWS US, all connection types User Experience: As connection indexing has been reenabled, there should no longer be any issue with slow navigation or search of warehouse schema. Incident Start Time: June 1st 2023, Approximately 13:00 UTC Incident End Time: June 2nd, 2023, Approximately 06:40 UTC We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs.
- postmortem Jun 16, 2023, 11:16 PM UTC
Sigma Engineering has completed the postmortem of this incident. A Root Cause Analysis \(RCA\) is available on the Sigma Community site: [**Postmortem for May 30, 2023 Incident -Connection Indexing bug - Sigma AWS**](https://community.sigmacomputing.com/t/postmortem-for-may-30-2023-incident-connection-indexing-bug-sigma-aws/2375)