HashiCorp Outage History

Status: Identified Many customers are seeing failed Terraform runs with SIC-001 errors or 403 forbidden responses. We have confirmed around 220 similar errors in VCS audit logs. We have found the root cause and are working on a fix. Once we have additional information, we will share another update. Affected components HCP Terraform (Degraded performance)

Status: Identified We have identified an issue affecting the creation of new Disaster Recovery (DR) clusters. Customers attempting to create a DR cluster may encounter provisioning failures. Our engineering team has identified the cause and is working on a resolution. Existing clusters and workloads are not impacted. We will provide updates as more information becomes available.

Status: Identified Customers may see a blank, white screen while using HCP Terraform. This outage currently only impacts the UI; API calls, CI integrations, and CLI usage should not be affected at this time. Our Engineering team has identified the cause and we are actively working on a fix. Once we have additional information, we will share another update. Affected components HCP Terraform (Partial outage)

Status: Identified Our Engineering team has identified the cause and we are actively working on a fix. A workaround would be to pin the aws provider to v6.56.0 till the fixed patch is released. Once we have additional information, we will share another update. Affected components HCP Terraform (Partial outage)

Status: Identified Our Engineering team has identified the cause and we are actively working on a fix to publish a patch version of v6.57.1 and pull v6.57.0 from the registry. Prior to that we advise working around the issue by pinning the AWS provider to v6.56.0. Once we have additional information, we will share another update. Affected components HCP Terraform (Partial outage)

Status: Identified Our Engineering team has identified the cause and we are actively working on a fix. Once we have additional information, we will share another update.

Status: Identified Terraform Registry is experiencing elevated error rates affecting terraform init workflows and documentation access. Our Engineering team has identified the cause and we are actively working on a fix. Once we have additional information, we will share another update. Affected components Terraform Registry (Degraded performance)

Status: Identified Our engineering team has identified the cause as an upstream platform change, and we’re actively coordinating with the relevant provider while we work toward a fix. We’ll share another update as soon as we have more information. Affected components HCP Terraform (Degraded performance)

Status: Identified Our engineering team continues to coordinate with the relevant provider while we work toward a fix. We’ll share another update as soon as we have more information. Affected components HCP Terraform (Degraded performance)

Status: Identified Our engineers have identified a malfunction preventing HCP Vault Radar scanning jobs from launching. We're working to resume processing new jobs as soon as possible. Scanning jobs will queue up and be processed once the malfunction has cleared. Affected components HCP Vault Radar (Degraded performance)

Status: Identified Our engineering team has un-blocked new Vault Radar scanning jobs. The system is working through a backlog of jobs accumulated during the malfunction. We're working to scale up workers to process the backlog more quickly. Affected components HCP Vault Radar (Degraded performance)

Status: Identified Our Engineering team has identified the cause Our Engineering team has identified the cause to be with an upstream provider. We are working with the provider to restore functionality as soon as possible. Once we have additional information, we will share another update. Affected components HCP Portal (Degraded performance)

Status: Identified Terraform Registry is returning errors at an elevated rate, affecting terraform init workflows and documentation access. Our engineering team is preparing to scale up the database backing some Terraform Registry operations. Affected components Terraform Registry (Degraded performance)

Status: Identified Terraform Registry service is degraded, with requesters seeing elevated errors. Our engineering team is scaling up the database backing some Registry requests. Affected components Terraform Registry (Degraded performance)

Status: Identified Our engineering team has implemented a fix to improve the Terraform Registry error rate. Customers should see a significant improvement. We are closely monitoring the service and continue to investigate some residual errors. Affected components Terraform Registry (Degraded performance)

Status: Identified We have identified the cause for difficulty with logging in to HCP Terraform. Our team is working to resolve the issue. We will post updates with more information as it becomes available. Affected components HCP Terraform (Degraded performance)

Status: Identified Our team is continuing to work on resolving the issue with logging in to HCP Terraform. We will post updates with more information as it becomes available. Affected components HCP Terraform (Degraded performance)

Status: Identified We have identified the issue with packages not being available in our apt repository. Our team is working to resolve the issue. We will post updates with more information as it becomes available. Affected components APT Repository (Full outage)

Status: Identified We have identified the issue with packages not being available in our apt repository. Our team is continuing to work on resolving the issue. We will post updates with more information as it becomes available. Affected components APT Repository (Full outage)

Status: Identified We are continuing to work on restoring functionality of our apt repository. We will post updates with more information as it becomes available. Affected components APT Repository (Full outage)

Status: Identified We are continuing to work on restoring functionality of our apt repository. We will post updates with more information as it becomes available. Affected components APT Repository (Full outage)

Status: Identified We have identified the issue and are working on a fix for self-hosted HCP Terraform agents failing to start when auto-upgrading from 1.28.6+ to 1.28.9, causing run failures in HCP Terraform workspacesOur team is working to identify and resolve the issue. Please refer to this KB article for symptoms and workarounds until the fix is released - https://www.ibm.com/support/pages/node/7272788 Affected components HCP Terraform (Degraded performance)

Status: Identified Our Engineering team has identified a number of critical problems with Terraform 1.15.0 and certain configurations. If you are experiencing issues with this release of Terraform, please retry with 1.14.9. The Terraform Development team is actively working to release fixes in v1.15.1 as soon as possible. Affected components Releases Site (Partial outage)

Status: Identified HCP Boundary is currently experiencing a control plane degradation that prevents users from managing clusters via the portal, while existing clusters and active sessions remain healthy and unaffected. Our team has identified the cause and are actively working to restore full control plane functionality for HCP Boundary. Affected components HCP Boundary (Partial outage)