Section experienced a major incident on June 1, 2021 affecting DNS, lasting 1h 25m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 01, 2021, 07:16 PM UTC
Section engineering is investigating DNS issues.
- identified Jun 01, 2021, 07:35 PM UTC
We've identified the issue with the DNS resolution and our engineers are working on a fix.
- monitoring Jun 01, 2021, 07:41 PM UTC
A fix has been implemented to remediate DNS resolution issues and we are monitoring the changes.
- resolved Jun 01, 2021, 08:41 PM UTC
Section Engineering has confirmed this issue is now completely resolved.
- postmortem Jun 02, 2021, 07:24 PM UTC
A DNS resolution issue with the Section platform resulted in customer web applications being inaccessible to end-users. Section runs redundant DNS providers to improve total availability. Section’s platform received internal errors that corrupted platform decisions about DNS routing when communicating with the DNS provider’s API. As DNS propagated, customer web applications began to become inaccessible by end-users. Section engineering worked to correct the faulty records by successfully migrating to Section’s secondary DNS provider. The duration of the incident would have varied by customer depending on the timing of complete DNS propagation. An internal fix has been rolled out to production.