Paubox incident

Customers receiving html "bad gateway" emails

Minor Resolved View vendor source →

Paubox experienced a minor incident on August 14, 2023 affecting Inbound Security, lasting 8h 5m. The incident has been resolved; the full update timeline is below.

Started
Aug 14, 2023, 03:04 PM UTC
Resolved
Aug 14, 2023, 11:09 PM UTC
Duration
8h 5m
Detected by Pingoru
Aug 14, 2023, 03:04 PM UTC

Affected components

Inbound Security

Update timeline

  1. identified Aug 14, 2023, 03:04 PM UTC

    Some customers have reported receiving html emails with "bad gateway" errors. This was caused by database timeouts on our footer microservice. We have temporarily disabled it to investigate the source of those timeouts. However, as the mail queue unspools, you may receive emails like this.

  2. monitoring Aug 14, 2023, 04:51 PM UTC

    Customers continue to report 504 bad gateway emails; a reminder that this will likely continue over the next 3 hours as our mail queue unspools.

  3. monitoring Aug 14, 2023, 10:05 PM UTC

    We are continuing to monitor for further issues.

  4. resolved Aug 14, 2023, 11:09 PM UTC

    During today's event contents of received / delivered mail may have been lost between the hours of ~8am and 12pm ET. We recommend resending and/or requesting contacts resend mail from this time period.