Tango Card incident
Disruptions on BHN AWS EKS Clusters impacted Multiple BHN Platforms
Tango Card experienced a critical incident on March 17, 2025 affecting RaaS API v2 - Production and Reward Link - Production and 1 more component, lasting 20s. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 17, 2025, 04:07 PM UTC
Business Impact: BHN was experiencing EKS issues in the AWS service that impacted the following systems: 1. Japan Region: • Lawson -> LoadIt flow (Google) o Pre-Authorizations (1032) o Shipments (182) o PSLOADIT (571) o GMGTOP (242) 2. US Region: • Giftcards.com - D2C • Tango - B2B • Rakuten - Affiliate orders
- resolved Mar 17, 2025, 04:07 PM UTC
Resolution: BHN has successfully resolved the issue. Our team collaborated closely with AWS to address the impact caused by AWS EKS Clusters. We are pleased to confirm that the system has fully recovered as of 12:00 PM PT. We will now initiate the Root Cause Analysis (RCA) process to prevent future occurrences. This issue impacted Tango Platforms where Tango Orders were failing (Tango Portal and Tango API). This is resolved now.