Coveralls incident

Elevated Latency

Minor Resolved View vendor source →

Coveralls experienced a minor incident on March 13, 2025 affecting Coveralls.io Web and Coveralls.io API, lasting 1h 5m. The incident has been resolved; the full update timeline is below.

Started
Mar 13, 2025, 03:12 PM UTC
Resolved
Mar 13, 2025, 04:17 PM UTC
Duration
1h 5m
Detected by Pingoru
Mar 13, 2025, 03:12 PM UTC

Affected components

Coveralls.io WebCoveralls.io API

Update timeline

  1. monitoring Mar 13, 2025, 03:12 PM UTC

    Elevated latencies system-wide. We have deployed resources to clear the backup. ETA to clear: ~20-min.

  2. monitoring Mar 13, 2025, 03:36 PM UTC

    Backed up jobs are about 50% cleared. ETA to normal: ~10-min.

  3. monitoring Mar 13, 2025, 03:51 PM UTC

    Latencies are back in normal range, but we continue to clear the remainder of backed up background jobs.

  4. resolved Mar 13, 2025, 04:17 PM UTC

    We have cleared all backed up jobs from this incident. Latencies are back in normal range; albeit normal for our highest-traffic days of the week (Wed-Thu, US workday). For those following our efforts to address the latencies we've experienced over the last several weeks, this weekend and next represent our final planned efforts to address these issues. We expect the work over this weekend and next to resolve the occasional spikes in latency we've been experiencing, especially during periods of high traffic. If you are still waiting for any of your builds created during this period (late Wed-early Thu, US) to complete, please reach out to us at [email protected] and we will investigate to ensure they don't have other causes and are completed.