Treefort had 11 outages in the last 2 years totaling 41h 31m of downtime — averaging 0.5 incidents per month.
There were 11 Treefort outages since March 27, 2026 totaling 41h 31m of downtime. Each is summarised below — incident details, duration, and resolution information.
Our authentication system is intermittently returning errors when users try to sign in. We're investigating the problem.
One of the authentication app servers encountered a fault. We've replaced the virtual machine with a new one and are seeing errors subside.
File uploads were broken in the admin dashboard.
The Tags tab of the admin dashboard is currently not display tags, and some collections are not being populated in apps. We're actively investigating the issue.
We're currently testing and deploying a fix for this issue.
The fix is live and full app and admin dashboard functionality is restored.
We're seeing heightened error rates in our API and some requests are intermittently failing. Dashboard analytics are affected and some content requests are loading slowly or not at all. We're currently investigating.
We've identified an issue with our analytics system. We are isolating the issue so that other aspects of the platform can fully recover while we work on a fix for analytics.
We are working on a fix for the analytics system. In the meantime analytics are still unavailable via the admin dashboard or API. We have finished processing webhooks that we backed up due to this issue and general access to the admin dashboard has been restored.
All systems have recovered. We will be sending out a post-mortem to customers shortly.
We are investigating network connectivity issues with an upstream provider. The Treefort admin dashboard is currently unavailable for some users.
The connectivity issues are affecting apps as well. Users on the west coast may experience slow load times. The upstream provider is investigating the issue
A fix is being implemented. In the meantime we are continuing to see sporadically slow load times.
The fix is complete and network connectivity has been fully restored.
We've identified a bad deployment that is causing articles to fail to load in apps and video series to fail to load in the admin dashboard.
Both issues have been resolved. App downtime for articles was ~33 minutes. Admin dashboard downtime for video series was ~43 minutes.
We are monitoring lingering issues with several apps related to the previous outage.
We are investigating a major platform outage.
Our upstream hosting provider is addressing an issue related to handling secure network traffic. We are seeing most services start to recover.
All services have recovered.
We're seeing a spike in failed requests to our API and are actively investigating. Some thumbnails and content may not load, and user authentication may be slow or encounter errors.
An upstream provider is experiencing capacity issues resulting in intermittent network failures. Services are recovering at this time and error rates have dropped significantly. We are continuing to monitor apps to ensure full recovery.
Our upstream provider is having hardware issues with the machines our authentication service runs on. We are working to provision additional machines to restore full service. Some actions that require authentication may intermittently fail in the meantime.
We've performed a database failover to a new primary node and are seeing services recover. We're continuing to monitor.
We're investigating problems with our authentication service and admin dashboard.
We've identified unusually high load on one of our authentication database servers. We've restarted the database cluster to restore baseline service but response times may continue to be slow as the database catches up.