Is Copado down?

We are currently investigating an issue impacting a subset of customers who are experiencing Git authentication errors when committing or promoting components. Our engineering team is actively working to identify the root cause and restore normal functionality as quickly as possible. We will continue to provide updates as more information becomes available.

We have identified that the Git authentication errors impacting customers are related to an ongoing GitHub service incident: https://www.githubstatus.com/ We are monitoring closely and will update this status when more information is available.

GitHub's status has been updated to indicate that the incident is resolved. We will monitor for now and update this incident to Resolved once we have confirmed that full functionality is restored.

We have determined that there were no additional occurrences in the last hour. This incident has been resolved.

We have received reports from a small number of customers experiencing repository-related issues with their CICD pipelines. Due to the pattern of these reports, we are currently investigating this as a potential service degradation. While your specific Orgs and CICD operations may not be impacted, please feel free to open a case in our Success Community if you are experiencing issues.

This has been resolved.

We are currently investigating a potential issue with Metadata Format Pipeline that is causing an error condition and potentially blocking releases. Our engineering team is actively investigating.  We will provide an update within the hour.

We are currently investigating reports of performance degradation impacting CI/CD pipelines. During this time, some users may also experience intermittent delays or unexpected validation errors when utilizing the CICD Pipeline, which may also affect the Data Deploy Service. Our engineering teams are actively looking into the situation to identify the root cause. We will provide an update as soon as more information is available.

The majority of the instability being experienced is due to the "frequent rotation of Refresh Tokens" now being enforced by Salesforce, which we are in the process of further mitigating, at scale.

Status update: Monitoring We have observed a complete drop in authentication errors over the last hour and currently consider this issue resolved. Our team will continue to monitor the system to ensure stability. Action required: If you experienced an error, please re-authenticate your credentials and retry your jobs. Please note that the main Credential for the Org where Copado is installed must be validated first; after that is complete, all subsequent Credential records must be validated by their respective record owners in Salesforce.

We have implemented the necessary backend mitigations to resolve the recent service disruptions, and system stability has been fully restored. Action required: If you experienced an error, please re-authenticate your credentials and retry your jobs. Please note that the main Credential for the Org where Copado is installed must be validated first; after that is complete, all subsequent Credential records must be validated by their respective record owners in Salesforce.

We are currently investigating an issue affecting Copado AI Services, where users may be experiencing consistent "Agentic LLM task failed" errors. Our engineering team has identified that this is stemming from an overloaded state with one of our upstream AI providers (Anthropic) in our primary hosting region, North America. We are treating this with the highest priority and will provide another update as soon as we have more information or a resolution.

We are continuing to investigate this issue.

We are continuing to investigate this issue.

We have successfully resolved the issue affecting Copado AI Services for our North American servers. Normal service has been fully restored, and users should no longer experience errors when utilizing AI features. We will continue to monitor the service closely to ensure optimal performance. We apologize for any inconvenience this caused and appreciate your patience while our team worked to restore service.

Update - Resolved Our monitoring period has concluded, and we have confirmed that Copado AI Services are fully operational and performing as expected for all North American servers. This incident is now resolved. Thank you for your patience.