Mailgun incident

Login Issues to Mailgun and intermittent connection issues to api.mailgun.net

Major Resolved View vendor source →

Mailgun experienced a major incident on February 12, 2024 affecting API and Control Panel, lasting 1d 6h. The incident has been resolved; the full update timeline is below.

Started
Feb 12, 2024, 09:06 AM UTC
Resolved
Feb 13, 2024, 04:01 PM UTC
Duration
1d 6h
Detected by Pingoru
Feb 12, 2024, 09:06 AM UTC

Affected components

APIControl Panel

Update timeline

  1. investigating Feb 12, 2024, 09:06 AM UTC

    We are currently investigating intermittent issues logging into the Mailgun control panel.

  2. investigating Feb 12, 2024, 10:41 AM UTC

    We are continuing to investigate this issue.

  3. identified Feb 12, 2024, 12:33 PM UTC

    We are seeing a DDOS attack against our login page and we have deployed mitigation changes to improve the experience for the legitimate users, still working on complete resolution.

  4. identified Feb 12, 2024, 02:45 PM UTC

    We are working with our cloud provider on possible mitigation strategy.

  5. identified Feb 12, 2024, 05:24 PM UTC

    Our cloud provider is working through internal escalation process to help us with the mitigation, meanwhile we are working on scaling up the infrastructure to support the load.

  6. identified Feb 12, 2024, 08:27 PM UTC

    We are continuing work to mitigate impact to our login page. More updates will be provided when information becomes available.

  7. monitoring Feb 13, 2024, 01:50 AM UTC

    A mitigation has been put in place to restore the functionality of our login page. We are continuing to monitor the DDOS attack.

  8. monitoring Feb 13, 2024, 01:40 PM UTC

    We are continuing to monitor our systems. All impacts of this attack have been mitigated at this time.

  9. resolved Feb 13, 2024, 04:01 PM UTC

    This incident has been resolved.