Codeberg incident

Cron jobs filling CI queue overnight

Resolved on November 20, 2024.

investigating Nov 20, 2024, 01:35 AM UTC

We have extended our monitoring for the hosted Woodpecker CI, including a check that jobs execute regularly and in time. Currently, cron jobs which run at about 0 UTC can fill the queue and report the CI as down, while it is just processing the backlog. We'll be adjusting our monitoring to reflect this.

Started
Nov 20, 2024, 01:35 AM UTC
Resolved
Nov 20, 2024, 01:35 AM UTC
Duration
–
Detected by Pingoru
Nov 20, 2024, 01:35 AM UTC

Update timeline

  1. investigating Nov 20, 2024, 01:35 AM UTC

    We have extended our monitoring for the hosted Woodpecker CI, including a check that jobs execute regularly and in time. Currently, cron jobs which run at about 0 UTC can fill the queue and report the CI as down, while it is just processing the backlog. We'll be adjusting our monitoring to reflect this.

Your product runs on more than Codeberg

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →