- Detected by Pingoru
- Jul 27, 2026, 08:29 AM UTC
- Resolved
- Jul 27, 2026, 08:29 AM UTC
- Duration
- —
Affected: Data Connector IntegrationsData Connector IntegrationsData Connector Integrations
Timeline · 1 update
-
resolved Jul 27, 2026, 08:29 AM UTC
Between 7/25 and today, 7/27 at 11:30 AM JST, we experienced a performance degradation issue affecting BulkLoad (Data Connector Import), Result Export (Activation) and Bulk Import. Following reports received this morning, our engineering team investigated the issue and identified high system load under specific conditions (increasing delay in internal components communication) as the root cause. The issue has been resolved by full rotation of our server nodes, and full performance was restored as of 11:30 AM JST. We sincerely apologize for any inconvenience caused. We are currently reviewing our monitoring and alerting rules to prevent similar issues in the future.
Read the full incident report →
- Detected by Pingoru
- Jul 07, 2026, 05:04 PM UTC
- Resolved
- Jul 07, 2026, 08:59 PM UTC
- Duration
- 3h 54m
Affected: Treasure Work / tdx
Timeline · 6 updates
-
investigating Jul 07, 2026, 05:04 PM UTC
We are observing degraded performance in Treasure Work and tdx in the Tokyo region. This issue is limited to the Claude Haiku 4.5 model in the Tokyo region only. Users may notice that requests using Claude Haiku 4.5 return errors or time out. At this time, we do not see any issues with other models. As a workaround, users can select a different model. We are actively investigating this issue and will aim to provide an update in 30 minutes.
-
investigating Jul 07, 2026, 05:40 PM UTC
We are continuing to investigate this issue and will provide another update in 30 minutes.
-
identified Jul 07, 2026, 06:07 PM UTC
We are continuing to explore this issue and are currently evaluating a potential fix. We will update as soon as our testing is complete.
-
identified Jul 07, 2026, 07:42 PM UTC
We are continuing to work through a potential fix and working to identify any potential contributing factors. Again, as the issue is localized to Haiku 4.5 models in the Tokyo region, we recommend users temporarily use a different model if they are experiencing any elevated error rates. We apologize for the inconvenience and will have another update soon.
-
monitoring Jul 07, 2026, 08:27 PM UTC
A fix has been implemented and we are monitoring the results.
-
resolved Jul 07, 2026, 08:59 PM UTC
This issue has been resolved. Treasure Work and tdx are operating normally, and the Claude Haiku 4.5 model in the Tokyo region is no longer experiencing errors or timeouts. Thank you for your patience.
Read the full incident report →
- Detected by Pingoru
- Jun 26, 2026, 09:48 PM UTC
- Resolved
- Jun 27, 2026, 01:13 AM UTC
- Duration
- 3h 24m
Affected: Hadoop / Hive Query Engine
Timeline · 5 updates
-
identified Jun 26, 2026, 09:48 PM UTC
We are experiencing Hive query performance degradation in the US region. This issue began on June 25, 2026. Users may observe longer than expected query execution times, particularly for long-running jobs with large data volumes. We have identified the cause and are working on a fix. We will provide an update in 30 minutes.
-
identified Jun 26, 2026, 10:22 PM UTC
We are experiencing Hive query performance degradation in the US region. This issue began on June 25, 2026. Users may observe longer than expected query execution times, particularly for long-running jobs with large data volumes. We have identified the cause. To address this, we are validating a cluster configuration change prior to applying it to the production environment. We will provide an update in 30 minutes.
-
identified Jun 26, 2026, 10:57 PM UTC
We are continuing to work on a fix. Our team is validating a cluster configuration change prior to applying it to the production environment. We will provide an update in 30 minutes.
-
monitoring Jun 26, 2026, 11:57 PM UTC
We have provisioned a new cluster with sufficient capacity and are now routing jobs to it. Query performance is expected to recover gradually as the cluster stabilizes. We are monitoring the situation closely. We will provide an update in 1 hour.
-
resolved Jun 27, 2026, 01:13 AM UTC
Hive query performance degradation in the US region has been resolved. We have successfully provisioned a new cluster and routed all traffic to it. Systems are now operating normally. Thank you for your patience.
Read the full incident report →
- Detected by Pingoru
- Jun 25, 2026, 11:46 AM UTC
- Resolved
- Jun 25, 2026, 11:46 AM UTC
- Duration
- —
Affected: Data Connector IntegrationsData Connector IntegrationsData Connector Integrations
Timeline · 1 update
-
resolved Jun 25, 2026, 11:46 AM UTC
Resolved — Some result export (data export) jobs in the US, Tokyo, and EU regions may have failed or been delayed between June 24, 2026 21:00 UTC and June 25, 2026 05:26 UTC. During this period, underlying compute nodes were intermittently unstable, which could cause export jobs to terminate before completing. In some cases an affected job may have ended without a clear error message.The issue has been resolved and all systems are operating normally. Data integrity is not impacted — source data in Treasure Data was unaffected; only the delivery of export jobs to external destinations during this window could have been disrupted.If you ran a result/data export during this window, we recommend confirming it completed and re-running it if the output looks incomplete. We will also contact affected customers directly. Thank you for your patience.
Read the full incident report →
- Detected by Pingoru
- Jun 24, 2026, 11:11 AM UTC
- Resolved
- Jun 24, 2026, 11:11 AM UTC
- Duration
- —
Affected: Engage Studio - Delivery API
Timeline · 1 update
-
resolved Jun 24, 2026, 11:11 AM UTC
We identified a delay in recording email event data (such as open, click, bounce, delivery events, and error events) to customer event tables. Affected period (approximate): - June 22, 03:45 UTC – June 23, 04:15 UTC - June 23, 07:00 UTC – June 24, 07:30 UTC During these periods, email event data recording was delayed. Email delivery itself was not affected — emails were sent and received normally. The issue has been resolved and all systems are operating normally. Delayed events have been fully processed. If you ran queries on event or error_event tables during the affected periods, we suggest rerunning those queries to get accurate results. We apologize for any inconvenience.
Read the full incident report →
- Detected by Pingoru
- May 05, 2026, 04:20 PM UTC
- Resolved
- May 05, 2026, 05:43 PM UTC
- Duration
- 1h 23m
Affected: Realtime 2.0Realtime 2.0Realtime 2.0
Timeline · 3 updates
Read the full incident report →
- Detected by Pingoru
- Apr 27, 2026, 05:31 PM UTC
- Resolved
- Apr 27, 2026, 06:25 PM UTC
- Duration
- 53m
Affected: CDP Personalization - Ingest APIRealtime 2.0
Timeline · 2 updates
Read the full incident report →
- Detected by Pingoru
- Apr 15, 2026, 01:35 AM UTC
- Resolved
- Apr 15, 2026, 01:35 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Mar 04, 2026, 01:54 AM UTC
- Resolved
- Mar 04, 2026, 01:54 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Mar 03, 2026, 02:50 AM UTC
- Resolved
- Mar 03, 2026, 02:50 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Feb 26, 2026, 02:52 AM UTC
- Resolved
- Feb 26, 2026, 02:52 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Feb 25, 2026, 02:55 AM UTC
- Resolved
- Feb 25, 2026, 02:55 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Feb 24, 2026, 02:19 AM UTC
- Resolved
- Feb 24, 2026, 02:19 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Feb 18, 2026, 10:00 PM UTC
- Resolved
- Feb 18, 2026, 10:00 PM UTC
- Duration
- —
Timeline · 1 update
-
monitoring Feb 18, 2026, 10:00 PM UTC
Feb 18, 14:00 PST Resolved - This incident has been resolved. Feb 18, 13:32 PST Monitoring - The performance went back to normal, and no errors are observed now. We will monitor at least for 15 minutes. Feb 18, 13:27 PST Identified - We have partially resolved the incident. We are continuously working to resolve the incident. Feb 18, 12:45 PST Investigating - We are investigating a possible problem currently affecting Treasure Insights. We will provide an update as soon as we know more.
Read the full incident report →
- Detected by Pingoru
- Jan 21, 2026, 05:07 AM UTC
- Resolved
- Jan 21, 2026, 05:07 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Jan 05, 2026, 02:11 PM UTC
- Resolved
- Jan 05, 2026, 02:11 PM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Dec 10, 2025, 06:03 AM UTC
- Resolved
- Dec 10, 2025, 06:03 AM UTC
- Duration
- —
Affected: REST APIREST APIREST APIREST APIREST API
Timeline · 1 update
-
resolved Dec 10, 2025, 06:03 AM UTC
An unexpected behavior occurred in the REST API "GET /v3/job/result/{job_id}" which caused it to return only a partial set of results. This issue stemmed from an update to the job result download mechanism implemented around 2025/12/09 01:00 (UTC). The issue was resolved after a fix was applied around 2025/12/10 04:36(UTC). The affected API is used through the following methods: - Directly calling the REST API - Using functions in libraries (e.g., pytd) that reference job results - Toolbelt commands that refers to job results - Setting store_last_results:true in the td>:/td_run> operator in Treasure Workflows - Using the td_for_each>, td_wait> and td_wait_table>: operators in Treasure Workflows Unfortunately, we are unable to identify which API requests were affected. Please compare the number of results retrieved by your job with the download results to see if you were affected. We sincerely apologize for the inconvenience this has caused.
Read the full incident report →
- Detected by Pingoru
- Dec 05, 2025, 09:30 AM UTC
- Resolved
- Dec 05, 2025, 09:30 AM UTC
- Duration
- —
Timeline · 1 update
-
monitoring Dec 05, 2025, 09:30 AM UTC
Dec 5, 01:30 PST Resolved - We confirmed the third-party service is now operational. The incident has been resolved. Dec 5, 01:22 PST Monitoring - The third-party service provider has implemented a fix. We are monitoring the results. Dec 5, 01:18 PST Investigating - We are currently experiencing issues accessing Treasure Insights. Our investigation has identified that this is caused by an outage with a third-party service provider utilized by Treasure Insights. We are monitoring the situation and working with the provider to resolve the issue. We will provide updates as soon as more information becomes available.
Read the full incident report →
- Detected by Pingoru
- Dec 03, 2025, 08:10 AM UTC
- Resolved
- Dec 03, 2025, 08:10 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Nov 25, 2025, 03:07 PM UTC
- Resolved
- Nov 25, 2025, 03:07 PM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Nov 18, 2025, 06:00 AM UTC
- Resolved
- Nov 18, 2025, 06:00 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Nov 12, 2025, 07:00 AM UTC
- Resolved
- Nov 12, 2025, 07:00 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Nov 05, 2025, 07:58 AM UTC
- Resolved
- Nov 05, 2025, 07:58 AM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Oct 20, 2025, 11:15 PM UTC
- Resolved
- Oct 20, 2025, 11:15 PM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →
- Detected by Pingoru
- Oct 20, 2025, 09:32 PM UTC
- Resolved
- Oct 20, 2025, 09:32 PM UTC
- Duration
- —
Timeline · 1 update
Read the full incident report →