Osano incident

Web application login issues

Minor Resolved View vendor source →

Osano experienced a minor incident on April 9, 2021 affecting Customer Authentication, lasting 2h 10m. The incident has been resolved; the full update timeline is below.

Started
Apr 09, 2021, 10:29 PM UTC
Resolved
Apr 10, 2021, 12:40 AM UTC
Duration
2h 10m
Detected by Pingoru
Apr 09, 2021, 10:29 PM UTC

Affected components

Customer Authentication

Update timeline

  1. investigating Apr 10, 2021, 12:12 AM UTC

    We are currently investigating the outage.

  2. identified Apr 10, 2021, 12:20 AM UTC

    Authentication APIs are returning an invalid response on logins. The engineering team has identified the issue and is working on a fix.

  3. resolved Apr 10, 2021, 12:43 AM UTC

    The issue has been resolved and all systems are functioning normally.

  4. postmortem Apr 10, 2021, 12:44 AM UTC

    A bug was introduced in the web application which affected a limited number of customer accounts. This bug caused a continuous loop on login which was not detected by the automated testing mechanisms. Osano engineering has introduced a new QA test to ensure future deployments do not cause a similar authentication error.