Syncrofy incident

Syncrofy - Degraded Performance

Critical Resolved View vendor source →

Syncrofy experienced a critical incident on October 22, 2024 affecting Web application and Document Submission Service, lasting 2h 37m. The incident has been resolved; the full update timeline is below.

Started
Oct 22, 2024, 11:43 AM UTC
Resolved
Oct 22, 2024, 02:21 PM UTC
Duration
2h 37m
Detected by Pingoru
Oct 22, 2024, 11:43 AM UTC

Affected components

Web applicationDocument Submission Service

Update timeline

  1. investigating Oct 22, 2024, 11:43 AM UTC

    One of the three zones Syncrofy is deployed to in IBM cloud is experiencing an outage. Traffic is not being correctly routed around the failure so some Syncrofy actions are failing. We are investigating the issue and will be sure to send out updates. Thank you for your patience.

  2. investigating Oct 22, 2024, 12:00 PM UTC

    We have turned off HTTP and SFTP transmissions while we investigate - we will send out an update as soon as we have everything back up and running.

  3. investigating Oct 22, 2024, 12:19 PM UTC

    We are continuing to investigate this issue.

  4. identified Oct 22, 2024, 01:38 PM UTC

    IBM has confirmed a network incident in DAL10. This is impacting the Syncrofy database connectivity. There is no ETA on resolution from IBM yet. All ingest and UI currently remains unavailable. We appreciate your patience and will continue to work to resolve as soon as possible. Thank you

  5. resolved Oct 22, 2024, 02:21 PM UTC

    Everything should be back up and working as expected at this time. We are asking all Customers to please review and replay any failed transfers to Syncrofy that may have occurred over the past ~3 hours. If you run into any issues or have any questions, please reach out to the Support team via the ticketing system and we'll be happy to review! Thank you all again for your patience during this outage.