DigitalOcean incident

Guardrails Service Disruption Impacting Customers

Minor Resolved View vendor source →

DigitalOcean experienced a minor incident on December 2, 2025 affecting Agent Runtime, lasting 18h 50m. The incident has been resolved; the full update timeline is below.

Started
Dec 02, 2025, 08:55 PM UTC
Resolved
Dec 03, 2025, 03:45 PM UTC
Duration
18h 50m
Detected by Pingoru
Dec 02, 2025, 08:55 PM UTC

Affected components

Agent Runtime

Update timeline

  1. identified Dec 02, 2025, 08:55 PM UTC

    As of 20:07 UTC on December 2, 2025, our Engineering team has detected increased guardrail latency which may produce long response times for agents with attached guardrails. Engineering is working on a fix. We apologize for the inconvenience and will share an update once we have more information. Thank you for your patience and understanding as we work to resolve this issue.

  2. investigating Dec 02, 2025, 09:47 PM UTC

    Our Engineering team is currently investigating increased guardrail latency, which may cause long response times for agents with attached guardrails. We apologize for the inconvenience and will share an update once we have more information. Thank you for your patience and understanding as we work to resolve this issue.

  3. monitoring Dec 02, 2025, 11:21 PM UTC

    Our Engineering team has implemented a fix that has significantly reduced the impact of the issue, largely mitigating the outage. Although the situation has improved, some users may still experience intermittent latency issues. We are closely monitoring the results and will continue to work towards full resolution. We will provide another update once we have confirmed the issue is fully resolved.

  4. resolved Dec 03, 2025, 09:45 PM UTC

    Our Engineering team has fully implemented and confirmed the effectiveness of the fix for the increased guardrail latency. System performance has returned to normal, and all affected services are operating as expected. We have observed stable metrics during extended monitoring and have not detected any further latency or interruptions. If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.