Syncplicity incident

Service partial outage

Major Resolved View vendor source →

Syncplicity experienced a major incident on December 8, 2022 affecting US Desktop Clients Service and US MySite Web Content and 1 more component, lasting 8h 31m. The incident has been resolved; the full update timeline is below.

Started
Dec 08, 2022, 01:26 PM UTC
Resolved
Dec 08, 2022, 09:58 PM UTC
Duration
8h 31m
Detected by Pingoru
Dec 08, 2022, 01:26 PM UTC

Affected components

US Desktop Clients ServiceUS MySite Web ContentUS Cloud File StorageUS API GatewayUS API DeveloperUS DASUS Mobile Clients

Update timeline

  1. investigating Dec 08, 2022, 01:26 PM UTC

    We are currently investigating this issue.

  2. investigating Dec 08, 2022, 02:57 PM UTC

    We are continuing to investigate this issue.

  3. investigating Dec 08, 2022, 04:24 PM UTC

    During our investigations of the issue, we have managed to localize the problem and are working to make the changes required to get the system back online. The issue is affecting several core databases and impacting those clients whose metadata is stored and processed by these databases. Unfortunately we aren't able to give a definitive time estimate currently though we have several engineers working to resolve the issue. We will continue to post updates with new information. Our next update will be around 1pm ET or before.

  4. investigating Dec 08, 2022, 06:08 PM UTC

    The investigations are still ongoing with positive results. It is difficult to predict when all systems will be restored, though the engineers continue to work on the issue. Next update will be around 3pm ET (or sooner).

  5. identified Dec 08, 2022, 08:05 PM UTC

    We continue to work on the problem, approaches to solving the problem have been formed. Process of making changes consists of 5 stages. We are currently in the second stage, but it is still hard to estimate when service functionality will be restore, as it takes a long time to make some changes. We have a good news that data is not corrupted and consistent. Next update will be around 4pm ET (or sooner).

  6. monitoring Dec 08, 2022, 09:19 PM UTC

    A fix has been implemented and we are monitoring the results.

  7. resolved Dec 08, 2022, 09:58 PM UTC

    This incident has been resolved.