Resolved after 14 days 8 hours, affecting Developer API, on September 16, 2025.
Provisioning of new GPU nodes in our GKE environments began returning to normal overnight. We are now seeing only minimal delays in node creation, and service performance has largely stabilized. We are working on expanding our infrastructure and are actively monitoring node availability.
Affected components
Update timeline
- identified Sep 16, 2025, 04:25 PM UTC
We are currently experiencing issues provisioning new GPU nodes in our GKE environments. This is causing a reduced capacity in the number of requests we're able to serve simultaneously, leading to longer response times and clips failing to generate.
- monitoring Sep 17, 2025, 04:08 PM UTC
Provisioning of new GPU nodes in our GKE environments began returning to normal overnight. We are now seeing only minimal delays in node creation, and service performance has largely stabilized. We are working on expanding our infrastructure and are actively monitoring node availability.
- resolved Sep 30, 2025, 11:16 PM UTC
This incident has been resolved.
Your product runs on more than WellSaid Labs
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services