Virtru incident

ACM increased error rate

Major Resolved View vendor source →

Virtru experienced a major incident on October 6, 2023 affecting Virtru Secure Email Clients and Virtru Secure Reader and 1 more component, lasting 30m. The incident has been resolved; the full update timeline is below.

Started
Oct 06, 2023, 08:17 PM UTC
Resolved
Oct 06, 2023, 08:47 PM UTC
Duration
30m
Detected by Pingoru
Oct 06, 2023, 08:17 PM UTC

Affected components

Virtru Secure Email ClientsVirtru Secure ReaderVirtru Secure ShareHosted Gateway

Update timeline

  1. investigating Oct 06, 2023, 08:17 PM UTC

    We are currently investigating increased error rates on our ACM service which handles encrypt/decrypt key management operations.

  2. identified Oct 06, 2023, 08:22 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Oct 06, 2023, 08:22 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. monitoring Oct 06, 2023, 08:24 PM UTC

    We are continuing to monitor for any further issues.

  5. resolved Oct 06, 2023, 08:47 PM UTC

    A backend database experienced brief connectivity issues which resulted in health checks marking our ACM service as unhealthy, preventing requests reaching the service. No data loss has been observed, but customer encrypt/decrypt operations would have failed during the outage period (~10 minutes). Virtru will be conducting an RCA to determine further reliability improvements to implement.