Sigma Computing incident

Workbooks not loading for Sigma users on AWS Snowflake

Major Resolved View vendor source →

Sigma Computing experienced a major incident on September 14, 2023 affecting Sigma - AWS (Europe) and Sigma - AWS (US), lasting 2h 43m. The incident has been resolved; the full update timeline is below.

Started
Sep 14, 2023, 02:41 PM UTC
Resolved
Sep 14, 2023, 05:24 PM UTC
Duration
2h 43m
Detected by Pingoru
Sep 14, 2023, 02:41 PM UTC

Affected components

Sigma - AWS (Europe)Sigma - AWS (US)

Update timeline

  1. investigating Sep 14, 2023, 02:41 PM UTC

    We are investigating an issue with workbooks not loading and queries hanging. We are treating this as our highest priority. Our apologies for any inconvenience caused. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW Incident Start Time: Approximately 14:12 UTC September 14, 2023

  2. investigating Sep 14, 2023, 03:15 PM UTC

    We are continuing to investigate this issue.

  3. monitoring Sep 14, 2023, 03:27 PM UTC

    Our engineers have implemented mitigation measures and we are monitoring the effect closely. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW User Experience: We expected workbooks to load normally starting 14:48 UTC for AWS US users and at 15:01 UTC for AWS EU users. Incident Start Time: Approximately 14:12 UTC Sep 14, 2023 Note: A correction was made for the incident start time to be in 24-Hour time

  4. resolved Sep 14, 2023, 05:24 PM UTC

    The mitigation measures have proven effective, and the issue is resolved. We will perform a root cause analysis (RCA) and publish our findings in a postmortem note to the Sigma Community site in coming days. You will receive a notification when that occurs. Impacted Cloud Regions & Services: Sigma users hosted on AWS US & AWS EU using Snowflake CDW Incident Start Time: Approximately 12:49 UTC September 14, 2023 Incident End Time: Approximately 14:39 UTC September 14, 2023

  5. postmortem Sep 29, 2023, 06:31 PM UTC

    Sigma Engineering has completed the postmortem of this incident. A Root Cause Analysis \(RCA\) is available on the Sigma Community site: [Postmortem for September 14th, 2023; Workbooks not loading for Sigma users on AWS Snowflake](https://community.sigmacomputing.com/t/post-mortem-for-september-14th-2023-workbooks-not-loading-for-sigma-users-on-aws-snowflake/2604)