Sticky incident

Database Performance Degradation

Major Resolved View vendor source →

Sticky experienced a major incident on November 3, 2022 affecting Transaction API and Analytics and 1 more component, lasting 20h 19m. The incident has been resolved; the full update timeline is below.

Started
Nov 03, 2022, 07:41 PM UTC
Resolved
Nov 04, 2022, 04:00 PM UTC
Duration
20h 19m
Detected by Pingoru
Nov 03, 2022, 07:41 PM UTC

Affected components

Transaction APIAnalyticsMembership APIAdmin Portalportal.sticky.io

Update timeline

  1. investigating Nov 03, 2022, 07:41 PM UTC

    We are currently experiencing Database Server Degradation affecting the sticky.io merchant portal and APIs. Our Engineering Team is working to resolve and we will post an update as soon as possible.

  2. identified Nov 04, 2022, 03:54 AM UTC

    We have successfully recreated the affected database cluster and are in the process of deploying and testing now.

  3. monitoring Nov 04, 2022, 04:08 AM UTC

    Our engineering Team has deployed and tested the new database cluster. We can confirm that normal operations have been restored for most affected systems. Please note that Analytics operations may still be impacted while we bring the system back to full stability. However, we are now seeing heathy web and API traffic and transactions being processed across all previously affected instances. We will continue to update as we work to fully resolve the issue.

  4. resolved Nov 04, 2022, 04:00 PM UTC

    We have confirmed that all systems, including Analytics operations, are stable and healthy across all instances.