LogRocket incident

Search and metrics data performance degraded

Minor Resolved View vendor source →

LogRocket experienced a minor incident on December 8, 2022 affecting Dashboard and Issues and 1 more component, lasting 3h 26m. The incident has been resolved; the full update timeline is below.

Started
Dec 08, 2022, 01:45 AM UTC
Resolved
Dec 08, 2022, 05:12 AM UTC
Duration
3h 26m
Detected by Pingoru
Dec 08, 2022, 01:45 AM UTC

Affected components

DashboardIssuesMetricsAlerts

Update timeline

  1. investigating Dec 08, 2022, 01:45 AM UTC

    We are investigating performance and availability issues with our primary search database. This impacts searching for sessions, loading metrics, and ingestion of event data into the search database. Session recording ingestion is not impacted by this performance issue.

  2. identified Dec 08, 2022, 03:01 AM UTC

    We have completed recovery work on the data store and are beginning to backfill search, metrics, and issues data. This process will take several hours to complete and we will continue to monitor the system during that time. No data will be lost. While the backfill is in progress, metrics alerts will not trigger or resolve.

  3. resolved Dec 08, 2022, 05:12 AM UTC

    All systems are functioning normally again.