Simetrik incident

Latency Issues Due to Snowflake Service Incident

Major Resolved View vendor source →

Simetrik experienced a major incident on March 19, 2025 affecting Accounting Translator WEB application and Data Analysis WEB application and 1 more component, lasting 9h 50m. The incident has been resolved; the full update timeline is below.

Started
Mar 19, 2025, 04:55 PM UTC
Resolved
Mar 20, 2025, 02:46 AM UTC
Duration
9h 50m
Detected by Pingoru
Mar 19, 2025, 04:55 PM UTC

Affected components

Accounting Translator WEB applicationData Analysis WEB applicationData Export serviceUniversal Reconciliator WEB application

Update timeline

  1. identified Mar 19, 2025, 04:55 PM UTC

    Greetings, We would like to inform you that our database provider, Snowflake, has reported an incident with their service, which may cause latency in the loading of information in spreadsheets and dashboards. At the moment, we are monitoring the situation and will continue to follow up with Snowflake. We will keep you updated on any developments. Thank you.

  2. identified Mar 19, 2025, 05:31 PM UTC

    Our team is actively monitoring the latency issues, caused by the incident with our database provider, Snowflake. We are in close communication with Snowflake and awaiting further updates on their resolution process. We will provide another update as soon as we have more information. Thank you for your patience.

  3. identified Mar 19, 2025, 05:43 PM UTC

    We are continuing to work on a fix for this issue.

  4. identified Mar 19, 2025, 05:56 PM UTC

    Snowflake continues to work on resolving the issue causing the reported latency. Our team remains in close contact with them, actively monitoring the situation to ensure a timely resolution.

  5. identified Mar 19, 2025, 06:58 PM UTC

    Snowflake continues to implement multiple mitigation measures to remediate the impact, including increasing capacity and simultaneously rolling back the most recent software releases. Our team remains in close communication with Snowflake and is actively monitoring the situation to ensure a swift resolution.

  6. monitoring Mar 19, 2025, 08:00 PM UTC

    Following additional mitigation efforts by Snowflake, service health is gradually recovering. Snowflake is continuing to implement optimizations and closely monitor the affected environments as the remaining cloud services layer clusters complete their recovery. Our team remains in close contact with Snowflake and will provide further updates as the situation evolves. Thank you for your continued patience.

  7. monitoring Mar 19, 2025, 09:06 PM UTC

    Snowflake has confirmed that all clusters are reporting service health recovery following the implementation of mitigations for this issue. However, please note that recovery times may still vary across the affected infrastructure. Snowflake will continue to monitor the environment until they are confident all services are functioning properly. Our team remains in close contact with Snowflake and will provide further updates as needed. Thank you for your continued patience and understanding.

  8. monitoring Mar 19, 2025, 10:08 PM UTC

    Snowflake has confirmed that their service has been fully restored and is now operating normally. At Simetrik, we are now focusing on executing pending processes that were impacted during the incident. We appreciate your patience as we work through these tasks.

  9. resolved Mar 20, 2025, 02:46 AM UTC

    We have closely monitored the stability of Snowflake's service, and it is in fact fully restored. As a result, we are officially closing this incident. Moving forward, we will continue to review and monitor the performance of the impacted services within our tools to ensure ongoing stability and optimal functionality. Additionally, the Root Cause Analysis (RCA) for this incident will be published shortly in our Help Center for your reference. Thank you for your patience and understanding throughout this situation. If you have any further questions or concerns, please feel free to reach out to our team.