Hypernode incident
Issues at cloud provider causing unresponsive Hypernodes
Hypernode experienced a major incident on November 4, 2022 affecting Hypernode Servers, lasting 1h 30m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- investigating Nov 04, 2022, 07:40 AM UTC
We are getting reports about unresponsive webshops and customers not being able to SSH into their Hypernode. Our cloud provider is investigating this issue. We will update this status when we know more.
- identified Nov 04, 2022, 07:51 AM UTC
The issue has been identified and a fix is being implemented.
- monitoring Nov 04, 2022, 08:06 AM UTC
A fix has been implemented and we are monitoring the results.
- resolved Nov 04, 2022, 09:10 AM UTC
The issues are under control and are being closely monitored. We are resolving this for now and should a new incident pop-up a new one will be created. We will provide a post mortem about this soon.
- postmortem Nov 04, 2022, 09:11 AM UTC
Around 08:25 CET we started received reports from our customers that their webshops went offline or had intermittent connectivity issues. We contacted our cloud provider and they have informed us at 08:34 CET they are being targeted by a DDOS attack. At that point they were actively working at mitigating the issue but unfortunately this still caused intermittent issues for a lot of customers up to around 09:05 CET at which point we noticed everything became stable. Around 09:24 CET they confirmed to us everything was under control again, we kept the incident open for another 45 minutes to ensure we did not see any further disruptions. The engineers at our cloud provider were fortunately quick with addressing the issue so affected customers should only have seen intermittent issues minimal downtime. Should you experience any issues today please notify our support team, but for now we believe the issues to have been resolved.