SynchroNet incident

Unable to login and/or slow page response time

Major Resolved View vendor source →

SynchroNet experienced a major incident on November 25, 2020 affecting API and API and 1 more component, lasting 1d. The incident has been resolved; the full update timeline is below.

Started
Nov 25, 2020, 03:54 PM UTC
Resolved
Nov 26, 2020, 04:28 PM UTC
Duration
1d
Detected by Pingoru
Nov 25, 2020, 03:54 PM UTC

Affected components

APIAPIDashboardDashboard

Update timeline

  1. investigating Nov 25, 2020, 03:54 PM UTC

    We are currently investigating this issue.

  2. investigating Nov 25, 2020, 04:02 PM UTC

    Various AWS services that support CLICK internals are facing increased API error rate.

  3. investigating Nov 25, 2020, 04:15 PM UTC

    AWS is reporting issues in ACM, Amplify Console, API Gateway, AppStream2, AppSync, Athena, Cloudformation, Cloudtrail, CloudWatch, Cognito, Connect, DynamoDB, EventBridge, IoT Services, Lambda, LEX, Managed Blockchain, Resource Groups, SageMaker, Support Console, and Workspaces. You can watch their Service Health Dashboard for more information: https://status.aws.amazon.com/

  4. investigating Nov 25, 2020, 05:13 PM UTC

    The list of affected AWS services has been extended to: ACM, Amplify Console, API Gateway, AppMesh, AppStream2, AppSync, Athena, AutoScaling, Batch, CloudFormation, CloudTrail, CloudWatch, Cognito, Connect, DynamoDB, EventBridge, IoT Services, Lambda, LEX, Managed Blockchain, Resource Groups, SageMaker, Support Console, and Workspaces.

  5. investigating Nov 25, 2020, 09:55 PM UTC

    The AWS issue is still ongoing, and we have had reports that multiple customers are unable to access CLICK at all. We are continuing to work both internally and with AWS to resolve the issue.

  6. investigating Nov 26, 2020, 01:46 AM UTC

    As the issues on the AWS side are being resolved, we have been able to restore access to CLICK for our customers. Users may experience degraded performance at this time.

  7. resolved Nov 26, 2020, 04:28 PM UTC

    At 4:00 AM PST all issues were resolved and access to CLICK is restored.