Ember IT experienced a major incident on June 6, 2017, lasting 1h 32m. The incident has been resolved; the full update timeline is below.
Update timeline
- investigating Jun 06, 2017, 10:17 PM UTC
Monitoring has indicated an outage in our Valley Forge Datacenter affecting all customers there. We are investigating the issue now.
- monitoring Jun 06, 2017, 10:35 PM UTC
Connectivity has been restored.
- resolved Jun 06, 2017, 11:49 PM UTC
Ember IT Clients, At 6:00pm today Ember IT's Valley Forge datacenter experienced a full outage lasting 32 minutes. Over the weekend we worked with a TierPoint (datacenter) technician to upgrade our Internet connection. This has to be done on their end and ours at the same time. During the scheduled maintenance they were not able to complete this action. It had to be rescheduled. At 6:00pm today I was notified that the technician that we worked with over the weekend decided to unilaterally make the change. Because this wasn't scheduled and we not onsite to adjust our firewall at the same time, connectivity to all 5 ISPs dropped. I have a call scheduled with TierPoint management tomorrow to address this. Thank you.