Athennian incident

Intermittent performance issues

Major Resolved View vendor source →

Athennian experienced a major incident on September 28, 2022, lasting —. The incident has been resolved; the full update timeline is below.

Started
Sep 28, 2022, 05:10 PM UTC
Resolved
Sep 26, 2022, 07:00 PM UTC
Duration
Detected by Pingoru
Sep 28, 2022, 05:10 PM UTC

Update timeline

  1. resolved Sep 28, 2022, 05:10 PM UTC

    Users are experiencing "503" errors and are unable to reach the application.

  2. postmortem Sep 28, 2022, 05:10 PM UTC

    On Monday, September 26th, 2022, we experienced intermittent outages for some Canadian customers between 12:51 pm to 1:31 pm MST. A recent change involving the transition between Web Application Firewall \(WAF\) providers adversely impacted the production environment causing other application health safeguards to kick in to action creating the intermittent access issues for customers hosted in our Canadian data centers. Systems in place immediately notified our team of the issue. We then worked to restore the system back to full operation for all customers. Further, steps have been taken to ensure our change management procedures consider potential spill over issues while working with third-party security infrastructure providers.