Zipline incident
Search is partially degraded. Document contents are not searchable for some customers.
Zipline experienced a minor incident on October 27, 2020 affecting Search, lasting 6h 50m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Oct 27, 2020, 05:09 PM UTC
Some customers are experiencing problems with search results in the Resource Library. Our engineers are currently applying a fix.
- identified Oct 27, 2020, 05:14 PM UTC
The issue has been identified and a fix is being implemented.
- identified Oct 27, 2020, 06:57 PM UTC
The search issue that users were experiencing has been resolved. However, in an abundance of caution we are rebuilding the document index. The contents of documents are not currently searchable. We will continue to update the status page as that index is rebuilt.
- monitoring Oct 27, 2020, 08:22 PM UTC
Resource Library documents are still being reindexed. Organizations have been prioritized by their support tier and geography. We estimate the complete reindexing to be finished by 3:30 PDT. The issue is isolated to the content of Resource Library documents not being searchable. Search continues to operate normally during this time for all other content.
- resolved Oct 27, 2020, 11:59 PM UTC
All documents have been reindexed successfully and should be searchable. We have been monitoring for the past hour and seen no more issues. We are working on a root cause analysis to share what happened in more detail.