Aptible incident

Operations blocked - Route 53 propagation delays

Aptible experienced a major incident on February 13, 2025 affecting Aptible Deploy, lasting 57m. The incident has been resolved; the full update timeline is below.

Started: Feb 13, 2025, 11:51 PM UTC
Resolved: Feb 14, 2025, 12:48 AM UTC
Duration: 57m
Detected by Pingoru: Feb 13, 2025, 11:51 PM UTC

Affected components

Aptible Deploy

Update timeline

identified Feb 13, 2025, 11:51 PM UTC

We've noticed that some Operations are failing due to Route53 record changes not propagating within the 10 minute time limit allowed by our platform. In order to prevent Apps and Databases DNS records from reaching an inconsistent state, we are temporarily blocking Operations. Performance and reachability of existing Apps and Database is not impacted.
monitoring Feb 14, 2025, 12:26 AM UTC

We are noticing Route 53 record requests succeeding in a normal time frame, and are lifting the operation block at this time. We'll continue to observe running operations to ensure stability.
resolved Feb 14, 2025, 12:48 AM UTC

This incident has been resolved.