Sharetribe had 13 outages in the last 2 years totaling 31h 24m of downtime — averaging 0.5 incidents per month.
There were 13 Sharetribe outages since May 24, 2024 totaling 31h 24m of downtime. Each is summarised below — incident details, duration, and resolution information.
After the database maintenance performed today, our data indexing service did not properly recover, resulting in search indexes containing stale data for roughly 2.5 hours. In addition, due to an issue with the service's metric reporting, our monitoring system did not generate a timely alert. We are taking steps to prevent this from happening in the future.
Marketplace API experienced elevated latency and error rates. The incident is resolved.
We saw increased latency in the Marketplace API and addressed the issue. It went back to normal after 20 minutes. We keep monitoring the situation.
We're experiencing increased API latency and are currently looking into the issue.
We identified the issue and took action. We are seeing API latency coming down. We keep monitoring the situation.
We are continuing to monitor for any further issues.
This incident has been resolved.
There is ongoing incident in Amazon Web Services US East 1 region. While Sharetribe own services are not hosted there and are not directly affected, some 3rd party integrations may be affected, including Chargebee (our Sharetribe subscription management service) and Intercom (customer support platform). For details on the status of those services, see: * Chargebee - https://status.chargebee.com/ * Intercom - https://www.intercomstatus.com/
This incident has been resolved.
There was an increased delay in the Event processing pipeline between 9:25 - 9:40. The issue is now resolved and the Event processing pipeline has caught up.
We experienced an elevated level of API errors around 16:15-16:20 UTC.
Around 18:20 to 18:25 UTC we encountered elevated latency in Marketplace and Integration APIs, caused by a database component failover.
From 21:15 to 21:25 UTC on September 20th we saw elevated error rates in Marketplace and Integration APIs. The incident was caused by faulty autoscaling of our search system.
The search engine was partially unavailable between 00:19 and 01:08 UTC. This affected all the API endpoints that use search, e.g., the Marketplace API `/listings/query` endpoint. During this time, the endpoints that use search returned 5xx responses. Our system couldn't recover from the partial outage without manual intervention. We keep investigating why the system didn't recover automatically and how we can improve it to prevent similar outages in the future.
We are currently investigating an issue causing delays in Event processing
The issue has been identified and a fix is being implemented.
This incident has been resolved.
We are seeing elevated error rates in API responses. We are investigating the issue.
Increased delay in processing background jobs
We rolled back some recent changes, which we suspect caused the issue. All systems are operating normally. We will keep monitoring the situation.
This incident has been resolved.
Up to 30 minutes of delay in background job processing between 23:31 - 23:59 UTC.