Netdata incident

404 errors with Netdata RHEL 8.x repositories with latest repository configuration packages.

Major Resolved View vendor source →

Netdata experienced a major incident on January 22, 2026 affecting Agent Repositories, lasting 2h 32m. The incident has been resolved; the full update timeline is below.

Started
Jan 22, 2026, 12:47 PM UTC
Resolved
Jan 22, 2026, 03:20 PM UTC
Duration
2h 32m
Detected by Pingoru
Jan 22, 2026, 12:47 PM UTC

Affected components

Agent Repositories

Update timeline

  1. identified Jan 22, 2026, 12:47 PM UTC

    We have identified an issue with the latest version of the repository configuration packages for our RHEL 8.x repositories that causes systems which update to that version of the repository configuration package to become unable to access our repositories. This affects all systems that use our repository configuration packages to access our RHEL 8.x repositories, including but not limited to RHEL 8.x, Alma Linux 8.x, Rocky Linux 8.x, and Oracle Linux 8.x. Affected systems will report a failure to download repository metadata for Netdata repositories. A fix is currently being tested and is expected to be deployed soon.

  2. identified Jan 22, 2026, 12:48 PM UTC

    We are continuing to work on a fix for this issue.

  3. monitoring Jan 22, 2026, 02:06 PM UTC

    The primary fix has been deployed and appears to be working correctly. We are currently working on a followup fix to allow affected systems to update properly without requiring user intervention. Until that additional fix is deployed, affected systems can be manually updated to fully resolve the issue locally by fetching the latest version of the repository configuration package manually and installing it on the system: - For most RHEL 8 equivalent systems using our stable repositories: https://repository.netdata.cloud/repos/repoconfig/el/8/x86_64/netdata-repo-5-4.noarch.rpm - For most RHEL 8 equivalent systems using our nightly repositories: https://repository.netdata.cloud/repos/repoconfig/el/8/x86_64/netdata-repo-edge-5-4.noarch.rpm - For Oracle Linux 8 systems using our stable repositories: https://repository.netdata.cloud/repos/repoconfig/ol/8/x86_64/netdata-repo-5-4.noarch.rpm - For Oracle Linux 8 systems using our nightly repositories: https://repository.netdata.cloud/repos/repoconfig/ol/8/x86_64/netdata-repo-edge-5-4.noarch.rpm

  4. resolved Jan 22, 2026, 03:20 PM UTC

    In addition to the fix for the repository configuration packages, a fix has been deployed to the repositories themselves that will enable affected systems to update successfully to the latest version of the repository configuration packages, and as such no further issues are expected.