DoControl experienced a minor incident on September 22, 2022 affecting Management portal, lasting 1d. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Sep 22, 2022, 12:47 PM UTC
We spotted delays in workflow execution runs. The team is currently Investigating the issue
- identified Sep 22, 2022, 01:44 PM UTC
The delay in processing events are only in the last 2.5 hours. Currently, the service is keeping up and decreasing the delays. next update on 30 mins
- monitoring Sep 22, 2022, 05:49 PM UTC
A fix was implemented, and the team still monitors this issue. All the events were processed successfully and there is no delays seen on the streaming processing that powers the workflow executions
- monitoring Sep 22, 2022, 07:44 PM UTC
System back to normal
- resolved Sep 23, 2022, 12:53 PM UTC
After a day that workflow exection are working without any issue this incident can be closed. Extra monitors and changes were deploy for future better handle of this issue