Cadmium incident

Eventscribe Registration Solution Outage

Resolved after 5 hours 36 minutes, affecting Registration, on October 8, 2024.

postmortem Oct 09, 2024, 03:48 PM UTC

This outage occurred when a vendor disabled the Eventscribe Registration Solutions’s Cloudflare account without advance notice. Cadmium staff was alerted immediately upon the sites going offline. To resolve the issue as quickly as possible, DNS records were updated to bypass the Cloudflare account. Once the DNS records propagated across the internet, the registration solution came back online. We apologize for any disruption this caused.

Started
Oct 08, 2024, 09:57 AM UTC
Resolved
Oct 08, 2024, 03:33 PM UTC
Duration
5h 36m
Detected by Pingoru
Oct 08, 2024, 09:57 AM UTC

Affected components

Registration

Update timeline

  1. investigating Oct 08, 2024, 09:57 AM UTC

    Our team is aware there is a service disruption with the registration module and is working swiftly to identify the root cause.

  2. identified Oct 08, 2024, 10:58 AM UTC

    The root cause has been identified, and our team is working as quickly as possible to fix the issue. Thank you for your patience! We will provide an update as soon as we have more information.

  3. identified Oct 08, 2024, 01:50 PM UTC

    Our team is still working on putting a fix in place. Some registration services may be available. We will provide an update as soon as we have more information.

  4. monitoring Oct 08, 2024, 02:22 PM UTC

    A fix has been put in place, and service has been restored. Our team is continuing to monitor the system.

  5. resolved Oct 08, 2024, 03:33 PM UTC

    The issue has been resolved.

  6. postmortem Oct 09, 2024, 03:48 PM UTC

    This outage occurred when a vendor disabled the Eventscribe Registration Solutions’s Cloudflare account without advance notice. Cadmium staff was alerted immediately upon the sites going offline. To resolve the issue as quickly as possible, DNS records were updated to bypass the Cloudflare account. Once the DNS records propagated across the internet, the registration solution came back online. We apologize for any disruption this caused.

Your product runs on more than Cadmium

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →