Mailgun incident

US Logs & Events API Issues

Minor Resolved View vendor source →

Mailgun experienced a minor incident on March 27, 2024 affecting Events & Logs, lasting 15h 45m. The incident has been resolved; the full update timeline is below.

Started
Mar 27, 2024, 11:52 AM UTC
Resolved
Mar 28, 2024, 03:37 AM UTC
Duration
15h 45m
Detected by Pingoru
Mar 27, 2024, 11:52 AM UTC

Affected components

Events & Logs

Update timeline

  1. investigating Mar 27, 2024, 11:52 AM UTC

    We are experiencing issues with our Events & Logs API for our US regions. You may notice missing events at the moment (API & Control panel). Engineering is investigating.

  2. identified Mar 27, 2024, 12:38 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Mar 27, 2024, 12:50 PM UTC

    The Events / Logs API & control panel are now working as expected. We continue to monitor closely.

  4. monitoring Mar 27, 2024, 02:26 PM UTC

    The Events API continues to operate as expected. Some customers may be missing events from 00:00 through 01:40 UTC. We are actively working on restoring that data.

  5. monitoring Mar 27, 2024, 03:41 PM UTC

    The work on restoring the missing data from 00:00 -> 1:40 UTC is still ongoing.

  6. monitoring Mar 27, 2024, 07:04 PM UTC

    The work on restoring the missing data from 00:00 -> 1:40 UTC is well underway. We continue to monitor the backfill process.

  7. monitoring Mar 27, 2024, 09:27 PM UTC

    The work on restoring the missing data from 00:00 -> 1:40 UTC continues. We are continuing to monitor the back fill process.

  8. resolved Mar 28, 2024, 03:37 AM UTC

    The data back fill process will complete shortly.