Proof incident

Issue with finalizing transaction documents.

Minor Resolved View vendor source →

Proof experienced a minor incident on January 19, 2025 affecting Proof Consumer (Web) and Notary Platform, lasting 4h 55m. The incident has been resolved; the full update timeline is below.

Started
Jan 19, 2025, 08:58 PM UTC
Resolved
Jan 20, 2025, 01:54 AM UTC
Duration
4h 55m
Detected by Pingoru
Jan 19, 2025, 08:58 PM UTC

Affected components

Proof Consumer (Web)Notary Platform

Update timeline

  1. investigating Jan 19, 2025, 08:58 PM UTC

    Proof has become aware of an issue where a subset of notary meetings are completing, but the finalization of the documents is getting stuck. We are investigating the cause of this. If the meeting completed successfully, the documents should eventually be finalized and available, but some customers will be seeing delays on getting those documents.

  2. investigating Jan 19, 2025, 09:55 PM UTC

    We are continuing to investigate this issue. It appears to be a situation with one of our certificate providers. We are also looking at possible mitigations to get around this issue until it is fully resolved. We will continue to provide updates as we get more information.

  3. investigating Jan 19, 2025, 11:27 PM UTC

    Proof is continuing to investigate the root cause of this issue while preparing a workaround. We will continue to provide updates as we learn more.

  4. identified Jan 19, 2025, 11:57 PM UTC

    We've identified the cause of this situation and have a fix in progress.

  5. monitoring Jan 20, 2025, 12:17 AM UTC

    The fix has been implemented. New transactions should be fine. The service is going through all earlier documents that did not finalize earlier and finalizing them now. We'll continue to monitor to make sure they are all in a good state.

  6. resolved Jan 20, 2025, 01:54 AM UTC

    The incident has been resolved. Documents that did not finalize earlier will be finalized automatically over the next few hours and then be available.