Bugfender experienced a minor incident on June 26, 2024 affecting Log ingestion API, lasting 3h 19m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jun 26, 2024, 02:44 PM UTC
Our log processing infrastructure is running behind which is causing that the logs sent to our servers are not shown in the dashboard. No logs have been lost, and we're working to process them as soon as possible.
- identified Jun 26, 2024, 02:54 PM UTC
We have identified the issue in a database server that's not working. Our engineers are looking into it. Log processing speed has recovered somewhat, but still below our 2-minute objective.
- identified Jun 26, 2024, 04:25 PM UTC
Our engineers are still working on the issue. Thank you for your patience.
- monitoring Jun 26, 2024, 05:46 PM UTC
A fix has been implemented by our engineers, and we're catching up with the log queue. Logs are still being processed with delay, but no logs are lost.
- resolved Jun 26, 2024, 06:03 PM UTC
Logs are now being processed at the usual speed, so we're declaring the incident resolved. We will continue to monitor performance especially closely over the next hours. We're sorry for the inconvenience caused and we thank you for your patience.