Bitrise Outage History

We are currently investigating a network outage affecting our ORD data center. Builds running in this data center may have failed or been delayed during the outage. Our team identified an issue with Proxmox storage in the affected data center and is working on a fix. We will provide a further update as soon as more information is available.

We are currently investigating reports of slow or hanging builds. Affected builds may stall or take significantly longer than usual during early phases such as cloning repositories or resolving Swift Package Manager dependencies. We will provide a further update as soon as more information is available.

We are continuing to investigate this issue.

We are continuing to investigate this issue.

We are investigating degraded performance affecting Build Cache in our IAD datacenter. Builds relying on cache may experience slower performance or cache misses.

We are currently investigating elevated errors observed for the Bitrise Workflow Editor. Users may experience increased HTTP errors, intermittent page load failures, or timeouts when accessing the site. Services impacted: The Workflow Editor may return errors or fail to load. Scope: [All users] Severity: [SEV-1] What we’re doing? Our Engineering teams are actively investigating this incident, monitoring alerts, and tracing requests to identify the root cause. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

We are currently investigating an incident causing elevated errors in Pipelines Services: Build Pipelines Scope: [All users] Severity: [SEV-1] What we’re doing? Our Engineering teams are actively investigating this issue. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

A subset of Bitrise builds are experiencing intermittent DNS failures. Scope: [A subset of users] Severity: [SEV-2] What we’re doing? Our Engineering teams are actively investigating this incident to identify the root cause. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

We are continuing to investigate this issue.

We are experiencing a delay in starting builds on Linux machines, we are investigating the issue.

We are seeing elevated error rates in Virtual Device Testing steps, resulting from the Google Cloud Tool Results API being intermittently unavailable. We are monitoring the situation.

We are currently investigating elevated build queues on Bitrise. Some users may experience longer-than-usual wait times for builds to start, as queued jobs take longer to be picked up. Services: Build start times and queue wait times; build execution itself remains normal once a worker is allocated. Scope: Builds on M4 Pro Stacks Severity: SEV-2 What we’re doing? Our Engineering teams are actively investigating causes, reviewing worker pool utilization, autoscaling events, recent deploys, and any upstream provider issues. We are analyzing metrics and logs to identify bottlenecks like unusually high build volume, throttling from third-party providers, etc. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

Gradle builds in the ORD data center are experiencing failures with dependency resolution. Some users may experience build failures Services: Gradle Repository Manager Scope: All builds in the ORD data center Severity: SEV-2 What we’re doing? Our Engineering teams are actively investigating root cause. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 15 minutes from now.

We are currently investigating an incident causing to be unavailable. Services: Data Center Connectivity Severity: SEV-1 What we’re doing? Our Engineering teams are actively investigating this issue. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

We are currently investigating an issue affecting artifact uploads in Release Management Store Releases. Most uploads are failing because valid requests to the Google Play AndroidPublisher API are incorrectly being marked as expired.

We are continuing to investigate this issue.

We are currently investigating a service disruption affecting account, team, and billing features on the Bitrise website. Users may observe their credits/build not being refreshed at the start of their billing cycle. Services: Features related to managing account details, teams and team members, billing and payments. Scope: A subset of users Severity: SEV-2 What we’re doing? Our Engineering teams are actively investigating this incident, monitoring alerts, and tracing requests to identify the root cause. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

We are currently investigating elevated build queues on Bitrise. Some users may experience longer-than-usual wait times for builds to start, as queued jobs take longer to be picked up. Services: Build start times and queue wait times; build execution itself remains normal once a worker is allocated. Scope: Queues on standard, elite, and elite-xl machines Severity: [SEV-2] What we’re doing? Our Engineering teams are actively investigating causes, reviewing worker pool utilization, autoscaling events, recent deploys, and any upstream provider issues. We are analyzing metrics and logs to identify bottlenecks like unusually high build volume, throttling from third-party providers, etc. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.

We have noticed build related issues with our web UI, starting new builds, incoming webhooks, and accessing build artifacts of running builds. We are currently investigating.

We are currently investigating this issue.

We have noticed an increased error rate when triggering builds, we are investigating the issue.

We are currently investigating an incident causing the Pipelines API endpoint to be unavailable Services: Bitrise API Scope: some users Severity: SEV-2 What we’re doing? Our Engineering teams are actively investigating this issue. We’re checking recent deploys, logs, CDN, DNS health, and server availability. We are working on immediate actions to remediate this issue. We will perform validated mitigations as soon as they are determined safe. When will the next update be available? You can expect a status update approximately 1 hour from now.