Knak incident

Issues with retrieving emails in studio

Major Resolved View vendor source →

Knak experienced a major incident on January 24, 2022 affecting Knak App, lasting 51m. The incident has been resolved; the full update timeline is below.

Started
Jan 24, 2022, 01:39 PM UTC
Resolved
Jan 24, 2022, 02:31 PM UTC
Duration
51m
Detected by Pingoru
Jan 24, 2022, 01:39 PM UTC

Affected components

Knak App

Update timeline

  1. investigating Jan 24, 2022, 01:39 PM UTC

    We are currently investigating this issue.

  2. resolved Jan 24, 2022, 02:31 PM UTC

    A spontaneous firewall issue was detected and addresed.

  3. postmortem Jan 28, 2022, 01:42 PM UTC

    We received reports from our customers that enumerating emails in the studio was not returning any results. This was accompanied by an increase in errors in our telemetry. After an investigation, it was found that our intelligent firewall within AWS had spontaneously started blocking this traffic. It interpreted the traffic as being an intrusion. Once the false-positive was addressed, the traffic flowed unimpeded thereafter and the incident was marked as resolved.