ClearFeed incident

Delays in processing events

Minor Resolved View vendor source →

ClearFeed experienced a minor incident on February 26, 2025 affecting Event Processing, lasting 17h 21m. The incident has been resolved; the full update timeline is below.

Started
Feb 26, 2025, 05:45 PM UTC
Resolved
Feb 27, 2025, 11:06 AM UTC
Duration
17h 21m
Detected by Pingoru
Feb 26, 2025, 05:45 PM UTC

Affected components

Event Processing

Update timeline

  1. identified Feb 26, 2025, 05:45 PM UTC

    We are observing delays and dropped events from Slack due to an ongoing outage on Slack's end.

  2. identified Feb 27, 2025, 02:35 AM UTC

    We are not receiving events from Slack, as Slack's status indicates issues with some custom apps not sending messages and disruptions with Slack Connect.

  3. identified Feb 27, 2025, 03:01 AM UTC

    Slack has started re-processing backend jobs to serve queued Events API requests. This process is expected to take several hours. Once completed, new events should begin flowing as expected. We will continue monitoring the situation and provide further updates as needed.

  4. identified Feb 27, 2025, 09:58 AM UTC

    We have started receiving events from Slack, but since there is no official update from Slack regarding the incident, we cannot confirm whether all events are being delivered or if some are still missing. However, based on our observations, things appear to be returning to normal. Additionally, there is no update from Slack on the status of older missed events, and so far, we have not received any of them. We will continue monitoring and provide further updates as we learn more.

  5. identified Feb 27, 2025, 11:06 AM UTC

    All systems are now functioning as expected. Slack has confirmed that the issues related to Slack APIs have been resolved. However, Slack is still working on replaying older events, and we will be able to process them as and when they arrive.

  6. resolved Feb 27, 2025, 11:06 AM UTC

    This incident has been resolved.