Capsule experienced a minor incident on March 27, 2023 affecting Capsule, lasting 4h 4m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Mar 27, 2023, 01:30 PM UTC
We are currently investigating this issue.
- monitoring Mar 27, 2023, 01:51 PM UTC
Performance has returned to normal.
- monitoring Mar 27, 2023, 04:23 PM UTC
We understand the underlying problem and are working on a permanent fix
- resolved Mar 27, 2023, 05:34 PM UTC
This incident has been resolved.
- postmortem Mar 28, 2023, 12:42 PM UTC
We're very sorry if you suffered from the periods of slow responses and elevated error rates with Capsule yesterday. We’ve tracked the issue down the a bug in our data stores query optimiser that resulted in what should have been a fast responding query taking several minutes to complete. This only happens in rare situations with an unusual configuration of data. While we fully understand the exact nature of the optimiser bug we have applied a fix that stops the bug from occurring. Once again we’re sorry for this disruption this caused.