Coveralls incident

Known Issue - Maintenance Window Required

Notice Resolved View vendor source →

Coveralls experienced a notice incident on June 29, 2024 affecting Coveralls.io Web and Coveralls.io API, lasting 1d 12h. The incident has been resolved; the full update timeline is below.

Started
Jun 29, 2024, 01:00 AM UTC
Resolved
Jun 30, 2024, 01:30 PM UTC
Duration
1d 12h
Detected by Pingoru
Jun 29, 2024, 01:00 AM UTC

Affected components

Coveralls.io WebCoveralls.io API

Update timeline

  1. identified Jun 29, 2024, 01:06 AM UTC

    We are working to resolve a known issue of Coveralls suddenly sending multiple PR comments to customer PRs, rather than one, updated PR comment that replaces older PR comments. This issue has been active for ~2.5 weeks. Our solution involves the need to change a column type in a production database table to accommodate larger integer values. With hundreds of millions of records and constant read/write activity, we will need to make this table change during a maintenance window scheduled for this weekend, Sat Jun 29-Sun, Jun 30. We will attempt to perform our changes on Saturday evening US PDT, but will update this post when the exact window is known. We will keep this "incident" open until the associated maintenance window has closed.

  2. resolved Jun 30, 2024, 06:18 PM UTC

    We have completed a key step in the resolution of the issue described here.