env0 Outage History

Type: Incident Affected Components: API Jan 13, 12:08:38 GMT+0 - Resolved - The issue was caused by a deployment mechanism failure, where one of the services did not deploy successfully while other services attempted to call newly introduced functions. Jan 13, 10:43:49 GMT+0 - Monitoring - We identified the issue and applied a quick fix. The system has returned to normal operation. We are continuing to monitor for any additional errors. Jan 13, 10:29:15 GMT+0 - Identified - The issue has been identified and a fix is being implemented.

Type: Incident Affected Components: API, Management Console Jan 7, 16:57:32 GMT+0 - Resolved - This incident has been resolved. Jan 7, 15:41:10 GMT+0 - Monitoring - We are continuing to monitor for any further issues. Jan 7, 15:39:47 GMT+0 - Monitoring - We're identified some issues regarding Authentication errors, we've implemented a fix and we're monitoring the situation

Type: Incident Affected Components: OpenTofu Module Registry Nov 18, 15:08:15 GMT+0 - Resolved - This incident has been resolved. Nov 18, 13:39:36 GMT+0 - Monitoring - OpenTofu Module Registry is unavailable because of Cloudflare outage.

Type: Incident Affected Components: API, Management Console Oct 20, 22:45:08 GMT+0 - Resolved - This incident has been resolved. Oct 20, 16:01:14 GMT+0 - Monitoring - We are continuing to monitor for any further issues. Oct 20, 16:01:00 GMT+0 - Monitoring - We are currently monitoring a widespread service disruption affecting our system. This incident is caused by a significant, ongoing network connectivity outage in AWS's US-EAST-1 Region, which is impacting multiple services including EC2, DynamoDB, and SQS. Our team is in contact with our provider and actively monitoring the situation. We will post an update as soon as AWS provides more information on their recovery.

Type: Incident Affected Components: API, Management Console Aug 26, 16:35:37 GMT+0 - Resolved - The incident has been resolved, environment management and deployments are operational Aug 26, 16:17:55 GMT+0 - Monitoring - The fix has been applied and we'll continue to monitor the situation Aug 26, 16:12:47 GMT+0 - Identified - We've identified the issue and the fix is currently being applied Aug 26, 14:51:05 GMT+0 - Investigating - We're investigating environment management and slowness in the env0 system, which occurred earlier today and started again

Type: Incident Affected Components: Management Console Aug 21, 12:38:46 GMT+0 - Resolved - This incident has been resolved. Aug 21, 12:21:54 GMT+0 - Monitoring - We are currently monitoring the situation. The rate of delayed deployments in env0 was greatly reduced, and we are currently monitoring to make sure that everything is back to normal Aug 21, 11:51:36 GMT+0 - Identified - Please perform a hard refresh of your page as soon as possible. Aug 21, 11:09:31 GMT+0 - Identified - Our team has identified the issue. Please perform a hard refresh of your page as soon as possible. We apologize for the inconvenience. Aug 21, 10:10:14 GMT+0 - Investigating - We are currently investigating an issue where deployments in the env0 app are not starting, are delayed, or are failing with an error.

Type: Incident Affected Components: Management Console Jul 28, 11:15:20 GMT+0 - Resolved - This incident has been resolved. Jul 28, 10:58:16 GMT+0 - Monitoring - We are continuing to monitor for any further issues. Jul 28, 10:46:23 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. Jul 28, 10:31:07 GMT+0 - Investigating - We are currently investigating this issue.

Type: Incident Affected Components: Management Console Jul 28, 09:36:06 GMT+0 - Resolved - We've identified some load on our cluster earlier, it has since subsided, and the issue is now resolved. Jul 28, 09:09:41 GMT+0 - Investigating - We are continuing to investigate this issue. Jul 28, 09:08:35 GMT+0 - Investigating - We are currently investigating this issue.

Type: Incident Affected Components: Management Console May 22, 17:10:34 GMT+0 - Resolved - This incident has been resolved. May 22, 17:01:10 GMT+0 - Investigating - We are currently investigating a sporadic issue with creating deployments in the env0 SaaS. env0 agents are currently unaffected.

Type: Incident Affected Components: Management Console Mar 26, 16:07:42 GMT+0 - Identified - A recent docker image upgrade caused a dependency issue, our teams are working on a fix. Mar 26, 17:00:00 GMT+0 - Resolved - This incident has been resolved.

Type: Incident Affected Components: API, Management Console Feb 23, 11:56:57 GMT+0 - Resolved - Outage resolved. Feb 23, 11:49:23 GMT+0 - Monitoring - Revert is done. Monitoring... Feb 23, 11:40:22 GMT+0 - Identified - Issue identified in one of our services. Revert in progress (~20m) Feb 23, 11:36:42 GMT+0 - Investigating - We are continuing to investigate this issue. Auto revert is upcoming. Feb 23, 11:36:32 GMT+0 - Investigating - We are seeing several errors when customers access the app. The issue is in investigation. Auto revert is upcoming.

Type: Incident Affected Components: Management Console Jan 19, 10:32:55 GMT+0 - Resolved - This incident has been resolved. Jan 19, 10:11:41 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. Jan 19, 09:31:12 GMT+0 - Investigating - We noticed that deployments are not getting started, our team is working on a fix for the issue.

Type: Incident Affected Components: API, Management Console Jan 14, 06:21:28 GMT+0 - Resolved - This incident has been resolved. Jan 14, 06:03:14 GMT+0 - Investigating - We are currently investigating this issue.

Type: Incident Affected Components: API, Management Console Dec 1, 10:58:59 GMT+0 - Resolved - This incident has been resolved. Dec 1, 10:46:39 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. Dec 1, 10:26:29 GMT+0 - Identified - We noticed some timeout errors in our system. Our team is on it.

Type: Incident Affected Components: API, Management Console Nov 25, 12:05:26 GMT+0 - Resolved - This incident has been resolved. Nov 25, 11:44:13 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. Nov 25, 11:42:22 GMT+0 - Identified - We identified some timeout errors in our system, our team is working on it.

Type: Incident Sep 29, 14:22:20 GMT+0 - Resolved - This incident has been resolved. Sep 29, 13:42:07 GMT+0 - Identified - The issue has been identified and a fix is being implemented.

Type: Incident Affected Components: Management Console Sep 16, 07:34:48 GMT+0 - Resolved - This incident has been resolved. Sep 16, 07:14:29 GMT+0 - Monitoring - We are continuing to monitor for any further issues. Sep 16, 07:12:30 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. Sep 16, 06:34:55 GMT+0 - Identified - We have identified and are working to resolve an issue when trying to deploy custom flows fetched from GitLab Enterprise Edition. We will roll out a fix shortly.

Type: Incident Affected Components: API, Management Console Jul 18, 10:14:15 GMT+0 - Resolved - This incident has been resolved. Jul 18, 09:37:12 GMT+0 - Identified - We currently having some issues completing deployment when using git refs (commit hashes) in place of branch name. The issue has been identified and a fix is being issued.

Type: Incident Affected Components: Management Console Jun 24, 10:44:13 GMT+0 - Resolved - This incident has been resolved. Jun 24, 10:37:34 GMT+0 - Identified - We've identified an issue with accessing the UI of env0 - our team is working on rolling out a fix

Type: Incident Affected Components: Management Console May 22, 11:29:13 GMT+0 - Resolved - This incident has been resolved. May 22, 11:18:15 GMT+0 - Monitoring - A fix has been implemented and we are monitoring the results. May 22, 10:32:45 GMT+0 - Identified - We have identified an issue with how we report git providers status checks. We are looking into rolling out a fix within the next 30 minutes