Platform9 incident

DNS Resolution Issues

Major Resolved View vendor source →

Platform9 experienced a major incident on July 27, 2023, lasting 1h 7m. The incident has been resolved; the full update timeline is below.

Started
Jul 27, 2023, 07:57 PM UTC
Resolved
Jul 27, 2023, 09:04 PM UTC
Duration
1h 7m
Detected by Pingoru
Jul 27, 2023, 07:57 PM UTC

Update timeline

  1. investigating Jul 27, 2023, 07:57 PM UTC

    We're currently investigating reports of issues related to DNS resolution, especially with regard to the Platform9 management plane endpoint. Hosts may intermittently or temporarily show as disconnected. Cluster workloads should remain unaffected.

  2. identified Jul 27, 2023, 08:22 PM UTC

    We've identified the issue with the automated DNS component which was causing issues properly synchronizing CNAME records for our Platform9 management plane instances. Our Operations team is taking steps to restore.

  3. monitoring Jul 27, 2023, 08:24 PM UTC

    Our Operations team has taken steps to resolve the issue. No further interruptions are anticipated at this time. Our team will continue to monitor the affected environments.

  4. resolved Jul 27, 2023, 09:04 PM UTC

    The incident may be considered resolved. No further interruptions have been observed nor reported.