ThinkOn Outage History

ThinkOn is up right now

ThinkOn had 49 outages in the last 2 years totaling 1561h 51m of downtime — averaging 2 incidents per month.

There were 49 ThinkOn outages since November 6, 2024 totaling 1561h 51m of downtime. Each is summarised below — incident details, duration, and resolution information.

Source: https://status.thinkon.com

Notice July 15, 2025

OTT2 / OTT2E - Key Management Server outage, affecting SOS service

Detected by Pingoru
Jul 15, 2025, 04:12 PM UTC
Resolved
Jul 17, 2025, 04:21 PM UTC
Duration
2d
Affected: OTT2 Object Storage
Timeline · 7 updates
  1. investigating Jul 14, 2025, 03:52 PM UTC

    We still continue working with a vendor to resolve this issue.

  2. investigating Jul 14, 2025, 07:41 PM UTC

    We are continuing to investigate this issue.

  3. identified Jul 14, 2025, 07:51 PM UTC

    We are continuing to work with the vendor to restore SOS services.

  4. identified Jul 15, 2025, 04:12 PM UTC

    ThinkOn Team is continuing to work with the vendor to restore SOS service.

  5. identified Jul 15, 2025, 05:32 PM UTC

    ThinkOn Team is continuing to work with the vendor to restore SOS service.

  6. identified Jul 15, 2025, 05:32 PM UTC

    We are continuing to work on a fix for this issue.

  7. resolved Jul 17, 2025, 04:21 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice July 10, 2025

PHX2 HCPCS Service Unavailable

Detected by Pingoru
Jul 10, 2025, 07:17 PM UTC
Resolved
Jul 10, 2025, 09:02 PM UTC
Duration
1h 45m
Affected: PHX2 Object Storage
Timeline · 2 updates
  1. investigating Jul 10, 2025, 07:17 PM UTC

    Our team is currently investigatng the issue.

  2. resolved Jul 10, 2025, 09:02 PM UTC

    Our team has resolved the issue.

Read the full incident report →

Notice July 9, 2025

OTT2 / OTT2E - Key Management Server outage, affecting SOS service and vCloud VM creation

Detected by Pingoru
Jul 09, 2025, 07:53 PM UTC
Resolved
Jul 10, 2025, 11:21 AM UTC
Duration
15h 27m
Affected: OTT2 Virtual Compute
Timeline · 3 updates
  1. investigating Jul 09, 2025, 07:53 PM UTC

    We continue working with a vendor to resolve this issue.

  2. investigating Jul 09, 2025, 08:00 PM UTC

    We are continuing to investigate this issue.

  3. resolved Jul 10, 2025, 11:21 AM UTC

    This incident has been resolved.

Read the full incident report →

Minor July 4, 2025

[MEL3] VMware Maintenance

Detected by Pingoru
Jul 04, 2025, 01:59 AM UTC
Resolved
Jul 04, 2025, 02:48 AM UTC
Duration
49m
Affected: MEL3 Virtual ComputeMEL3 Virtual Compute BackupsMEL3 Veeam Cloud Connect
Timeline · 2 updates
  1. identified Jul 04, 2025, 01:59 AM UTC

    We’d like to inform you that the scheduled vCloud Director upgrade maintenance at our MEL3 Data Center is currently experiencing a delay. The work is now expected to extend approximately one hour beyond the original maintenance window. Our teams are actively working to complete the upgrade as swiftly and safely as possible. Thank you for your patience and understanding.

  2. resolved Jul 04, 2025, 02:48 AM UTC

    This incident has been resolved.

Read the full incident report →

Minor June 5, 2025

[OTT2] HCPS Object Storage performance degradation

Detected by Pingoru
Jun 05, 2025, 04:19 PM UTC
Resolved
Jun 05, 2025, 09:59 PM UTC
Duration
5h 39m
Affected: OTT2 Object Storage
Timeline · 3 updates
  1. investigating Jun 05, 2025, 04:19 PM UTC

    The ThinkOn Team is currently working with the vendor to identify the issue.

  2. investigating Jun 05, 2025, 06:53 PM UTC

    The ThinkOn Team is continuing to work with the vendor to address the issue.

  3. resolved Jun 05, 2025, 09:59 PM UTC

    The ThinkOn Team has worked with the vendor to successfully resolve the issue.

Read the full incident report →

Notice May 16, 2025

CMB1 Site is down

Detected by Pingoru
May 16, 2025, 05:26 PM UTC
Resolved
May 17, 2025, 03:22 AM UTC
Duration
9h 56m
Affected: CMB1 Internet ConnectivityCMB1 Virtual ComputeCMB1 Veeam Cloud ConnectCMB1 ZertoCMB1 Object Storage
Timeline · 7 updates
  1. investigating May 16, 2025, 05:26 PM UTC

    We are currently investigating this issue.

  2. investigating May 16, 2025, 07:35 PM UTC

    We still continue to investigate this issue.

  3. investigating May 16, 2025, 09:46 PM UTC

    We are continuing to investigate this issue.

  4. identified May 17, 2025, 12:11 AM UTC

    Services in the CMB1 region are gradually coming back online. Our team continues to monitor the situation closely and is working to ensure full restoration as quickly and safely as possible.

  5. identified May 17, 2025, 12:19 AM UTC

    We are continuing to work on a fix for this issue.

  6. monitoring May 17, 2025, 12:21 AM UTC

    Services in the CMB1 region are gradually coming back online. Our team continues to monitor the situation closely and is working to ensure full restoration as quickly and safely as possible.

  7. resolved May 17, 2025, 03:22 AM UTC

    This incident has been resolved.

Read the full incident report →

Notice May 12, 2025

CMB1 VCloud is Down

Detected by Pingoru
May 12, 2025, 08:13 PM UTC
Resolved
May 12, 2025, 08:20 PM UTC
Duration
7m
Affected: CMB1 Internet ConnectivityCMB1 Virtual Compute
Timeline · 2 updates
  1. investigating May 12, 2025, 08:13 PM UTC

    We are currently investigating this issue.

  2. resolved May 12, 2025, 08:20 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice May 9, 2025

[MTL2] Network Connectivity

Detected by Pingoru
May 09, 2025, 07:58 AM UTC
Resolved
May 09, 2025, 06:25 PM UTC
Duration
10h 26m
Affected: MTL2 Internet ConnectivityMTL2 Object StorageMTL2 Virtual ComputeMTL2 Veeam Cloud ConnectMTL2 Virtual Compute Backups
Timeline · 5 updates
  1. investigating May 09, 2025, 07:58 AM UTC

    We are aware of connectivity issues impacting our MTL2 site and are actively investigating.

  2. investigating May 09, 2025, 09:53 AM UTC

    We are continuing to investigate this issue.

  3. investigating May 09, 2025, 10:24 AM UTC

    The issue is resolved.

  4. investigating May 09, 2025, 10:24 AM UTC

    The issue is resolved.

  5. resolved May 09, 2025, 06:25 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice May 8, 2025

Service Outage: Probax Hive Object Storage

Detected by Pingoru
May 08, 2025, 02:07 AM UTC
Resolved
May 09, 2025, 06:26 PM UTC
Duration
1d 16h
Timeline · 4 updates
  1. investigating May 08, 2025, 02:07 AM UTC

    Please be advised that the Probax Hive Object Storage service is currently experiencing an outage. ThinkOn is actively working with the vendor to investigate and resolve the issue. Impact: This outage affects clients’ ability to perform backups to Object Storage provisioned through Hive. All other services remain unaffected at this time. There is currently no estimated time for resolution (ETA). We will continue to provide updates as new information becomes available. Thank you for your patience.

  2. investigating May 08, 2025, 02:08 AM UTC

    Please be advised that the Probax Hive Object Storage service is currently experiencing an outage. ThinkOn is actively working with the vendor to investigate and resolve the issue. Impact: This outage affects clients’ ability to perform backups to Object Storage provisioned through Hive. All other services remain unaffected at this time. There is currently no estimated time for resolution (ETA). We will continue to provide updates as new information becomes available. Thank you for your patience.

  3. investigating May 08, 2025, 02:27 PM UTC

    Please be advised that the Probax Hive Object Storage service is currently experiencing an outage. ThinkOn is actively working with the vendor to investigate and resolve the issue. Impact: This outage affects clients’ ability to perform backups to Object Storage provisioned through Hive. All other services remain unaffected at this time. There is currently no estimated time for resolution (ETA). We will continue to provide updates as new information becomes available. Thank you for your patience.

  4. resolved May 09, 2025, 06:26 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor May 7, 2025

Service Interruption: Probax Hive Portal is down

Detected by Pingoru
May 07, 2025, 02:20 AM UTC
Resolved
May 07, 2025, 02:35 PM UTC
Duration
12h 15m
Timeline · 2 updates
  1. investigating May 07, 2025, 02:20 AM UTC

    Please be advised that the Probax Hive Portal is currently unavailable. ThinkOn is actively working with the vendor to resolve the issue. At this time, there is no estimated time for resolution (ETA). Important: This issue does not impact backups or any other services. We will provide updates as new information becomes available. Thank you for your patience.

  2. resolved May 07, 2025, 02:35 PM UTC

    This incident has been resolved.

Read the full incident report →

Major April 29, 2025

[OTT2] and [OTT2E] Partial operational outage

Detected by Pingoru
Apr 29, 2025, 08:33 PM UTC
Resolved
Apr 30, 2025, 05:57 PM UTC
Duration
21h 24m
Affected: OTT2 Virtual Compute
Timeline · 2 updates
  1. identified Apr 29, 2025, 08:33 PM UTC

    The issue has been identified and a fix is being implemented.

  2. resolved Apr 30, 2025, 05:57 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice March 18, 2025

PHX2 HCPCS Degraded Service

Detected by Pingoru
Mar 18, 2025, 11:08 PM UTC
Resolved
Mar 20, 2025, 12:20 AM UTC
Duration
1d 1h
Affected: PHX2 Object Storage
Timeline · 3 updates
  1. investigating Mar 18, 2025, 11:08 PM UTC

    We are facing a problem with one of our nodes at this time service may be degraded. If you experiencing a complete outage please submit a ticket to [email protected]

  2. monitoring Mar 19, 2025, 12:54 AM UTC

    After a thorough investigation we can confirm this is not impacting your services, at this time our engineers will continue to monitor

  3. resolved Mar 20, 2025, 12:20 AM UTC

    At this time we have not received any reports related to this incident and will be marking this as resolved. If any problems arise please submit a request to [email protected]

Read the full incident report →

Critical January 30, 2025

[KLP1] Service Outage

Detected by Pingoru
Jan 30, 2025, 05:33 AM UTC
Resolved
Jan 30, 2025, 06:14 AM UTC
Duration
40m
Affected: KLP1 Internet ConnectivityKLP1 Virtual Compute
Timeline · 2 updates
  1. identified Jan 30, 2025, 05:33 AM UTC

    We are currently experiencing an outage at KLP1. Our ThinkOn engineers have identified the issue and are working to resolve this issue.

  2. resolved Jan 30, 2025, 06:14 AM UTC

    The issue is resolved, at this time if you have a active ticket open we will be marking it as resolved, if you are still having issues you may reply back to the ticket to reopen. For those who do not have a ticket and is still having problems, you can call/email the contact below.

Read the full incident report →

Critical January 30, 2025

[CMH1] Service Outage

Detected by Pingoru
Jan 30, 2025, 05:14 AM UTC
Resolved
Jan 30, 2025, 06:50 AM UTC
Duration
1h 35m
Affected: CMH1 Internet ConnectivityCMH1 Virtual ComputeCMH1 Object StorageCMH1 Zerto Virtual ReplicationCMH1 Veeam M365
Timeline · 2 updates
  1. identified Jan 30, 2025, 05:14 AM UTC

    We are currently experiencing an outage at CMH1. Our ThinkOn engineers have identified the issue and are working to resolve this issue.

  2. resolved Jan 30, 2025, 06:50 AM UTC

    This issue is now resolved. At this time if you have a active ticket open we will be marking it as resolved, if you are still having issues you may reply back to the ticket to reopen. For those who do not have a ticket and is still having problems, you can call/email the contact below.

Read the full incident report →

Notice January 14, 2025

TOR10/OTT2

Detected by Pingoru
Jan 14, 2025, 07:51 PM UTC
Resolved
Jan 14, 2025, 11:07 PM UTC
Duration
3h 16m
Affected: TOR10 Virtual ComputeOTT2 Virtual Compute
Timeline · 3 updates
  1. identified Jan 14, 2025, 07:51 PM UTC

    Problem with the TOR10/OTT2 Domain Controller, preventing changes being made to VMs in vcloud director.

  2. identified Jan 14, 2025, 08:19 PM UTC

    We are continuing to work on a fix for this issue.

  3. resolved Jan 14, 2025, 11:07 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice December 19, 2024

OTT2 - Management cluster is down

Detected by Pingoru
Dec 19, 2024, 02:30 PM UTC
Resolved
Dec 19, 2024, 04:09 PM UTC
Duration
1h 38m
Affected: OTT2 Virtual Compute
Timeline · 4 updates
  1. investigating Dec 19, 2024, 02:30 PM UTC

    We are currently investigating this issue.

  2. investigating Dec 19, 2024, 03:11 PM UTC

    We are continuing to investigate this issue.

  3. identified Dec 19, 2024, 03:13 PM UTC

    The team is still working on this issue, we have confirmed this is not customer impacting.

  4. resolved Dec 19, 2024, 04:09 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice December 17, 2024

CGY3’s Object Storage system performance is degraded.

Detected by Pingoru
Dec 17, 2024, 03:20 PM UTC
Resolved
Dec 20, 2024, 04:48 PM UTC
Duration
3d 1h
Affected: CGY3 Object StorageCGY3 Veeam M365
Timeline · 6 updates
  1. investigating Dec 17, 2024, 03:16 PM UTC

    We are currently investigating this issue.

  2. investigating Dec 17, 2024, 03:20 PM UTC

    We are continuing to investigate this issue.

  3. investigating Dec 17, 2024, 05:20 PM UTC

    UPDATE - Our engineers have a fix implemented and resolved any slowness or degradation.

  4. investigating Dec 17, 2024, 05:22 PM UTC

    UPDATE - Our engineers have a fix implemented and resolved any slowness or degradation and the team is monitoring

  5. monitoring Dec 17, 2024, 10:00 PM UTC

    Issue has been resolved.

  6. resolved Dec 20, 2024, 04:48 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice December 16, 2024

FRP1 site is down

Detected by Pingoru
Dec 16, 2024, 05:32 PM UTC
Resolved
Dec 17, 2024, 04:22 PM UTC
Duration
22h 50m
Affected: FRP1 Internet ConnectivityFRP1 Virtual ComputeFRP1 Veeam Cloud ConnectFRP1 Virtual Compute Backups
Timeline · 4 updates
  1. identified Dec 16, 2024, 05:32 PM UTC

    UPS battery has died in FRP1. Awaiting for battery to be replaced.

  2. identified Dec 16, 2024, 05:35 PM UTC

    We are still working on restoring the services.

  3. monitoring Dec 17, 2024, 12:46 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Dec 17, 2024, 04:22 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice December 12, 2024

[NUBAV] - Network slowness

Detected by Pingoru
Dec 12, 2024, 09:10 PM UTC
Resolved
Dec 13, 2024, 12:14 AM UTC
Duration
3h 4m
Affected: NUBAV Internet ConnectivityNUBAV Object StorageNUBAV Virtual ComputeNUBAV Veeam Cloud ConnectNUBAV Zerto Virtual Replication
Timeline · 3 updates
  1. investigating Dec 12, 2024, 09:10 PM UTC

    You may experience slowness accessing your ThinkOn services. Our Engineers are currently investigating

  2. monitoring Dec 12, 2024, 10:31 PM UTC

    Our engineers have a fix implemented and we are monitoring the results

  3. resolved Dec 13, 2024, 12:14 AM UTC

    This incident has been resolved.

Read the full incident report →

Notice December 6, 2024

Nubav Outage

Detected by Pingoru
Dec 06, 2024, 11:29 AM UTC
Resolved
Dec 06, 2024, 07:02 PM UTC
Duration
7h 33m
Affected: NUBAV Internet Connectivity
Timeline · 5 updates
  1. investigating Dec 06, 2024, 11:29 AM UTC

    We are currently investigating this issue.

  2. investigating Dec 06, 2024, 12:18 PM UTC

    We are continuing to investigate this issue.

  3. monitoring Dec 06, 2024, 12:18 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. monitoring Dec 06, 2024, 12:22 PM UTC

    Nubav is network connectivity is currently back up. We're monitoring and investigating the root cause.

  5. resolved Dec 06, 2024, 07:02 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice November 19, 2024

TOR7 vCloud management portal is not reachable

Detected by Pingoru
Nov 19, 2024, 06:10 PM UTC
Resolved
Nov 19, 2024, 09:33 PM UTC
Duration
3h 22m
Affected: TOR7 Virtual Compute
Timeline · 2 updates
  1. investigating Nov 19, 2024, 06:10 PM UTC

    The TOR7 vCloud management portal is currently unreachable; however, the VMs should be functioning normally. Our Team is actively investigating this issue.

  2. resolved Nov 19, 2024, 09:33 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice November 6, 2024

[CMH1] Emergency Maintance for HCPS

Detected by Pingoru
Nov 06, 2024, 09:30 PM UTC
Resolved
Nov 07, 2024, 10:03 PM UTC
Duration
1d
Affected: CMH1 Object Storage
Timeline · 6 updates
  1. investigating Nov 06, 2024, 09:30 PM UTC

    Emergency Maintenance has been extended and will be finished before 18:00 ET.

  2. investigating Nov 06, 2024, 10:53 PM UTC

    We are seeing issues with the S-Nodes, and still are seeing errors. The team is working with the vendor to resolve this.

  3. monitoring Nov 07, 2024, 01:15 AM UTC

    Emergency Maintenance has been completed. We are monitoring performance with the vendor.

  4. monitoring Nov 07, 2024, 01:03 PM UTC

    We are continuing to monitor for any further issues.

  5. monitoring Nov 07, 2024, 10:03 PM UTC

    We are continuing to monitor for any further issues.

  6. resolved Nov 07, 2024, 10:03 PM UTC

    This incident has been resolved.

Read the full incident report →

Notice November 6, 2024

[OTT2] VCloud is down

Detected by Pingoru
Nov 06, 2024, 12:33 AM UTC
Resolved
Nov 07, 2024, 12:46 AM UTC
Duration
1d
Affected: OTT2 Virtual Compute
Timeline · 5 updates
  1. investigating Nov 06, 2024, 12:33 AM UTC

    We are currently investigating this issue.

  2. identified Nov 06, 2024, 03:25 AM UTC

    The issue has been identified and a fix is being implemented.

  3. identified Nov 06, 2024, 03:47 AM UTC

    We are continuing to work on a fix for this issue.

  4. monitoring Nov 06, 2024, 03:48 AM UTC

    A fix has been implemented and we are monitoring the results.

  5. resolved Nov 07, 2024, 12:46 AM UTC

    This incident has been resolved.

Read the full incident report →