Prompt.io incident

Chatbox Operations has investigated and identified issues with availability to some of its customers

Major Resolved View vendor source →

Prompt.io experienced a major incident on October 21, 2019 affecting Prompt.io (Production) - API and Prompt.io (Production) - Agent Tools, lasting 9d 19h. The incident has been resolved; the full update timeline is below.

Started
Oct 21, 2019, 09:01 PM UTC
Resolved
Oct 31, 2019, 04:36 PM UTC
Duration
9d 19h
Detected by Pingoru
Oct 21, 2019, 09:01 PM UTC

Affected components

Prompt.io (Production) - APIPrompt.io (Production) - Agent Tools

Update timeline

  1. investigating Oct 21, 2019, 09:01 PM UTC

    We are have identified an issue causing pages to not load or be extremely delayed to some of our customer base.

  2. identified Oct 21, 2019, 09:02 PM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Oct 21, 2019, 09:28 PM UTC

    Our services our operation again (as of 2:17pm PT). We have identified a deadlocking issue we are working to resolve. We have paused the use case that was identified as causing the deadlock. We will be re-enabling this use case once we have deployed a fix.

  4. monitoring Oct 22, 2019, 05:20 AM UTC

    A fix has been deployed to address the locking scenario that caused an availability issue to some of our customers. We will continue to monitor as this use case gets reenabled during business hours.

  5. resolved Oct 31, 2019, 04:36 PM UTC

    We have monitored the fix and consider this issue resolved.