nyris incident

INFRA-989

Critical Resolved View vendor source →

nyris experienced a critical incident on October 4, 2021 affecting Visual search and OCR search and 1 more component, lasting 57m. The incident has been resolved; the full update timeline is below.

Started
Oct 04, 2021, 08:45 AM UTC
Resolved
Oct 04, 2021, 09:43 AM UTC
Duration
57m
Detected by Pingoru
Oct 04, 2021, 08:45 AM UTC

Affected components

Visual searchOCR searchObject recognitionVisual recommendations

Update timeline

  1. investigating Oct 04, 2021, 08:45 AM UTC

    We are investigating reports of search failure for multiple indices.

  2. identified Oct 04, 2021, 08:50 AM UTC

    We have traced the issue to an error inside our message queuing backend and have applied fixes.

  3. monitoring Oct 04, 2021, 08:52 AM UTC

    Search appears to be stabilizing. We are continuing to monitor performance.

  4. resolved Oct 04, 2021, 09:43 AM UTC

    We are no longer seeing errors or degraded performance. The incident started on 03.10.2021 at around 16:00.