Paragon experienced a minor incident on November 21, 2023 affecting Workflows, lasting 29s. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 20, 2023, 10:28 PM UTC
We are currently investigating an issue where high-volume workflows are experiencing abnormally high queueing latencies. Workflows affected will appear in Task History as an actively executing workflow where the trigger step appears as perpetually executing. Impact is limited to high-volume workflows (using a Fan Out step over >100 items, having >100 concurrent active executions, and workflows triggered by integration-based triggers).
- identified Nov 21, 2023, 04:50 PM UTC
We are continuing to investigate this issue that is affecting a small number of high volume workflows. Recent tasks for these workflows are executing as expected; however, some older tasks are still identified as perpetually executing.
- resolved Nov 21, 2023, 07:25 PM UTC
We have confirmed that queueing latencies for high-volume workflows have returned to normal levels. All new workflow executions are performing as expected. Our Support team is reaching out to a small number of customers who may continue to see older perpetually-running executions in Task History.