Datacake incident
Data processing delays
Datacake experienced a minor incident on July 25, 2026 affecting GraphQL API and MQTT Server and 1 more component, lasting 4h 30m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Jul 25, 2026, 09:21 AM UTC
Our system is experiencing processing delays. No data has been lost, and the system should be caught up shortly.
- identified Jul 25, 2026, 10:35 AM UTC
We have identified the cause of the delays and implemented corrective measures. The fix has improved processing, but the existing queue backlog is still being cleared. Delays in data ingestion therefore continue at this time.
- monitoring Jul 25, 2026, 01:11 PM UTC
We have identified and resolved the root cause of the delays. An internal metrics exporter was placing additional load on the processing queue. We have implemented optimizations and are already seeing a significant performance improvement. The remaining backlog is still being processed, and we will provide another update once the queue has fully cleared. No data has been lost.
- resolved Jul 25, 2026, 01:51 PM UTC
The processing queue has now fully cleared, and all system metrics look healthy. No data was lost during the incident. We apologize for the inconvenience and will publish a detailed technical postmortem soon.