Proemion experienced a minor incident on January 31, 2019 affecting Mobile Network Services, lasting 22h 21m. The incident has been resolved; the full update timeline is below.
Affected components
Update timeline
- identified Jan 31, 2019, 09:07 AM UTC
One of our mobile network providers is currently facing infrastructure problems. Our partner is working actively on resolving the problem. At the moment we are monitoring the impact on our customers. Currently, we estimate 5% of affected devices across our customers. Unfortunately, it still might impact all devices of individual customers. The devices might not be able to establish a proper online connection. In that case, Real-Time connections are not possible. Logging data is buffered on the devices what mitigates the problem. We don't assume any data loss. The affected mobile network provider and their signaling vendor already started to activate traffic. This process is done with caution in order to prevent potential overload of the mobile network provider's infrastructure. We are sorry for the inconvenience and are in active contact with the affected mobile network provider.
- monitoring Jan 31, 2019, 01:31 PM UTC
We have noticed that our monitoring setups are back online again. Until now the provider has not indicated that the problem is solved. We will continue to monitor the situation.
- monitoring Jan 31, 2019, 03:31 PM UTC
Our monitoring tools show that the number of connected communication units is within the normal range again. Until now the provider has not indicated that the problem is solved. We will continue to monitor the situation.
- monitoring Jan 31, 2019, 03:32 PM UTC
We are continuing to monitor for any further issues.
- resolved Feb 01, 2019, 07:28 AM UTC
The mobile network provider informed us that the problem is resolved. Our monitoring shows that the number of online communication units is normal again. Logged datasets buffered in the non-volatile memory of the communication units has been transmitted to our system again. No data loss has been detected for our monitoring devices. We consider this issue as resolved. Our monitoring will continue to check the status.