Cribl incident

Monitoring page metrics are unavailable for some organizations.

Notice Resolved View vendor source →

Cribl experienced a notice incident on March 27, 2023, lasting —. The incident has been resolved; the full update timeline is below.

Started
Mar 27, 2023, 10:26 AM UTC
Resolved
Nov 20, 2022, 10:30 AM UTC
Duration
Detected by Pingoru
Mar 27, 2023, 10:26 AM UTC

Update timeline

  1. resolved Mar 27, 2023, 10:26 AM UTC

    November 20, 2022 | 11:33AM The rollout of the fix is completed, the monitoring page metrics and notifications are now available all Cribl Cloud organizations, thank you for your patience. November 20, 2022 | 05:32AM This issue has been mitigated and a fix applied. The rollout of this fix is taking longer than expected and will be completed for all organizations within the next 24 hours. November 20, 2022 | 02:43AM An unscheduled critical update is required to correct issues with missing metrics and notifications. This unscheduled update will roll out to all Cribl Cloud organizations between 9:30 and 11:00pm ET on 2022-11-19. Affected customers will have a gap in metrics for Stream Workers and Edge Nodes in the Monitoring view during the period of the outage. Any notifications configured will not have triggered during the outage. After the update monitoring metrics will resume as will any created notifications. This issue has not affected any customer data flows for Stream or Edge. No action is required by users to remediate this issue. November 20, 2022 | 02:25AM Unscheduled Critical Update for all Cribl Cloud Organizations Monitoring page metrics and notifications are currently unavailable for some organizations. An unscheduled critical update is required to correct issues with missing metrics and notifications. This unscheduled update will roll out to all Cribl Cloud organizations between 9:30 and 11:00pm ET on 2022-11-19 Customer Impact: Affected customers will have a gap in metrics for Stream Workers and Edge Nodes in the Monitoring view during the period of the outage. Any notifications configured will not have triggered during the outage. After the update monitoring metrics will resume as will any created notifications. This issue has not affected any customer data flows for Stream or Edge. Actions required from your side: No action is required by users to remediate this issue. Completion time: Between 9:30-11PM ET, your org will be picked up on a rolling basis for the fix. Once started, the update typically takes about 20 minutes to complet November 20, 2022 | 02:23AM Unscheduled Critical Update for all Cribl Cloud Organizations Monitoring page metrics and notifications are currently unavailable for some organizations. An unscheduled critical update is required to correct issues with missing metrics and notifications. This unscheduled update will roll out to all Cribl Cloud organizations between 9:00 and 10:00pm ET on 2022-11-19 Customer Impact: Affected customers will have a gap in metrics for Stream Workers and Edge Nodes in the Monitoring view during the period of the outage. Any notifications configured will not have triggered during the outage. After the update monitoring metrics will resume as will any created notifications. This issue has not affected any customer data flows for Stream or Edge. Actions required from your side: No action is required by users to remediate this issue. Completion time: Between 9:30-11PM ET, your org will be picked up on a rolling basis for the fix. Once started, the update typically takes about 20 minutes to complete. November 20, 2022 | 01:16AM We have identified the problem and are working on rolling out a fix to all affected services. November 20, 2022 | 01:16AM Users who navigate to the monitoring page within Edge or Stream may receive the following message: "The metrics service is not available because a configuration file doesn't exist or the settings are invalid." Notifications will not be sent while metrics are unavailable. No action is required from users. Cribl engineers are currently working to resolve this issue. status.cribl.cloud will be updated every 60 minutes or as the status changes.