10to8 experienced a critical incident on December 25, 2022 affecting Communications and Calendar Sync, lasting 2h 31m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Dec 25, 2022, 10:15 PM UTC
We are aware of an issue affecting Communications and Calendar Sync for some users of 10to8. Our engineering team has identified the cause of the issue and is currently working on a fix.
- monitoring Dec 25, 2022, 10:30 PM UTC
We are pleased to report that the issue affecting Communications and Calendar Sync has been resolved. The system is currently working through a long queue of messages and calendar sync updates, but you should see messages and your appointments syncing again. We will also ensure to only send messages for appointments in the future or that are relevant (like messages scheduled to be sent after an appointment); any other messages (like appointment reminders for appointments already passed) will not be sent to customers. We apologize for any inconvenience this may have caused.
- monitoring Dec 25, 2022, 11:31 PM UTC
Most messages have now been sent to customers, and most calendar syncs should be working as expected. The system is still catching up with reminder messages, as well as some calendar syncs and general notifications. This should all be caught up within the next few hours.
- resolved Dec 26, 2022, 12:47 AM UTC
The issue has been resolved, and all messages and calendar syncs have caught up.