Treasure Data incident

[Tokyo, AP03 Region] Custom Script Workflow error

Major Resolved View vendor source →

Treasure Data experienced a major incident on August 29, 2024 affecting Workflow and Workflow, lasting 44m. The incident has been resolved; the full update timeline is below.

Started
Aug 29, 2024, 10:14 AM UTC
Resolved
Aug 29, 2024, 10:59 AM UTC
Duration
44m
Detected by Pingoru
Aug 29, 2024, 10:14 AM UTC

Affected components

WorkflowWorkflow

Update timeline

  1. investigating Aug 29, 2024, 10:14 AM UTC

    Custom Script from workflow fails due to an ongoing incident with our infrastructure provider (AWS). Error example: Unable to execute HTTP request: Connect to sts.amazonaws.com:443 [sts.amazonaws.com/209.54.177.164] failed: connect timed out com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to sts.amazonaws.com:443 [sts.amazonaws.com/209.54.177.164] failed: connect timed out We are actively working on the issue on our end.

  2. monitoring Aug 29, 2024, 10:30 AM UTC

    The error rate is decreased. Please rerun the failed workflow if needed. We observed errors with the custom script between 8 am and 10 am UTC on August 29th. We keep monitoring the issue carefully.

  3. resolved Aug 29, 2024, 10:59 AM UTC

    Our infrastructure provider (AWS) issue is resolved and we don't observe new errors for now. Please rerun the failed workflow if needed