Duration: 1 hour and 42 minutes

Affected Components: Virtualization Cluster Frankfurt, DE (FRA1), Virtualization Cluster Frankfurt, DE (FRA2)

Feb 4, 12:16:00 GMT+0
Investigating - We see packet loss in our FRA2 facility starting 13:16 (German time). While all nodes are running, you might experience issues accessing your node. The situation is being investigated and we will update this post when we have new information. .

Feb 4, 13:57:31 GMT+0
Resolved - The incident has been resolved..

Duration: 16 hours and 59 minutes

Feb 2, 23:26:00 GMT+0
Resolved - We are currently investigating a network outage with our upstream provider that is affecting our infrastructure in Frankfurt, Germany. Our upstream provider is working on their network and informed us about an outage during a planned maintenance activity. See here for details: <https://status.dataforest.net/incidents/xst6r28991hy> We expected services to recover any minute..

Feb 2, 23:32:00 GMT+0
Monitoring - A fix has been implemented by dataforest at 00:31 (German time), leading to recovery of our services. The situation is under control and will be analyzed further. We will update this post as soon as we have new information..

Feb 3, 16:24:46 GMT+0
Resolved - This incident has been resolved..

Duration: 27 minutes

Affected Components: Virtualization Cluster Frankfurt, DE (FRA1), Website , Cloud Portal, Virtualization Cluster Frankfurt, DE (FRA2)

Oct 23, 11:49:54 GMT+0
Investigating - We are currently investigating a network outage with our upstream provider that is affecting our infrastructure in Frankfurt, Germany..

Oct 23, 12:16:31 GMT+0
Resolved - The network of our upstream provider was disconnected from 13:33 to 14:01 CEST, resulting in approximately 30 minutes of downtime for services in our FRA1/FRA2 data center. The issue was caused by a software bug in their aggregation switches, which triggered a major outage during a routine edge network change related to ongoing DDoS mitigation efforts. Layer 2 connectivity was completely lost and could only be restored by rebooting the affected devices. Connectivity was restored at 14:00 CEST, and BGP sessions have been stable since..

Duration: 8 hours

Affected Components: DNS Server, Virtualization Cluster Frankfurt, DE (FRA1)

May 24, 02:00:00 GMT+0
Identified - A maintenance will be performed on the weekend. ### WHEN? On May 24, 2025, starting at 4:00 AM (CEST), we will migrate our infrastructure from FRA1 to our new FRA2 facility, which became operational in January of this year. The maintenance is expected to last until 10:00 AM (CEST) due to the complex nature of the tasks involved. ### WHY? This migration is part of our ongoing commitment to improve our services and facilities. Several months ago, we experienced two brief power-related outages affecting FRA1, which were beyond our control. These incidents, among other factors, prompted us to reassess long-term risks and make necessary adjustments. The new FRA2 facility offers improved availability, 24/7 on-site support, and is built on our fully redundant core routing and switching infrastructure, including DDoS protection. During the maintenance window, we will be performing the following tasks: * Migration of physical servers to the new FRA2 region * Updates to our core virtualization layer * Integration into our new virtualization cluster * Migration to our upgraded routing and switching stack ### DETAILS Please take note of the following important information: * After completion, all nodes will automatically reboot. * There will be no changes to your assigned IP addresses or rDNS/PTR entries. * Our support team will be available throughout the maintenance period to assist you with any questions or concerns. * The migration will only affect nodes located within the FRA1 region; AMS1, FRA2, and SPO1 will remain online and unaffected. ### SUPPORT If you have any questions or concerns, please do not hesitate to contact us at [support@v6node.com](mailto:support@v6node.com) or by creating a support ticket. ### Timezones To help you plan accordingly, here’s the maintenance window in various local times: \- **New York (EDT)**: 23 May, from 22:00 to 04:00 (next day) \- **San Francisco (PDT)**: 23 May, from 19:00 to 01:00 (next day) \- **UTC**: 24 May, from 02:00 to 08:00 \- **London (BST)**: 24 May, from 03:00 to 09:00 \- **Tokyo (JST)**: 24 May, from 11:00 to 17:00 \- **Sydney (AEST)**: 24 May, from 12:00 to 18:00 \- **Dubai (GST)**: 24 May, from 06:00 to 12:00 \- **Mumbai (IST)**: 24 May, from 07:30 to 13:30 \- **Singapore (SGT)**: 24 May, from 10:00 to 16:00 \- **São Paulo (BRT)**: 23 May, from 23:00 to 05:00 (next day) We, the v6Node team, would like to take this opportunity to personally thank you for your continued trust and support. Best regards, The v6Node Team Ian, Jay, and Patrick.

May 24, 03:27:01 GMT+0
Identified - All servers have been shut down and dismantled. The servers are now being physically migrated to our new location FRA2\. .

May 24, 10:04:19 GMT+0
Completed - As of 10:20 am, all nodes have been restarted, and connectivity has been restored. A full status update will be provided shortly. If you have any questions or concerns in the meantime, please don't hesitate to contact our support team..

May 24, 04:25:16 GMT+0
Identified - The servers have arrived in the FRA2 facility..

May 24, 02:00:00 GMT+0
Identified - The maintenance has started..

Duration: 2 hours and 28 minutes

Affected Components: Virtualization Cluster Frankfurt, DE (FRA2)

May 23, 18:23:08 GMT+0
Investigating - Our monitoring showed some unresponsiveness to a small amount of nodes in our FRA2 location on host "pve1". We are currently investigating this incident..

May 23, 19:00:44 GMT+0
Identified - A failing NVMe device has been identified as the cause of the system hanging in an I/O wait state, which led to a lockup. All affected nodes are currently being migrated to different servers. There won’t be any data loss. All affected customers will receive an account credit as a compensation for this inconvenience. We will update this status report again when the migration has been finalised..

May 23, 20:51:34 GMT+0
Resolved - This incident has been resolved as of 21:31 CET. We will investigate the reason for the failure of the NVMe device after tomorrow's maintenance window. All customers will be reimbursed with a credit, you will get an information on that by e-mail. If you encounter any problems with your node, please contact our support team by e-mail to [support@v6Node.com](mailto:support@v6Node.com).

Affected Components: Website , Cloud Portal, Virtualization Cluster Frankfurt, DE (FRA1)

Dec 20, 07:28:56 GMT+0
Resolved - Connectivity has been restored, and current indications suggest an issue with the transport backhaul. We’ll continue monitoring the situation and provide further details as soon as possible..

Duration: 1 hour and 12 minutes

Affected Components: Website , Cloud Portal, Virtualization Cluster Frankfurt, DE (FRA1)

Dec 15, 05:55:00 GMT+0
Identified - To address the recent power incident in our fra1 datacenter, an urgent 15-20 minute maintenance window has been scheduled by our datacenter provider on **December 14, 2024 at 22:00 CET**. Unfortunately, both power feeds (A+B) will be unavailable, requiring a complete shutdown of all fra1 infrastructure. The shutdown will affect all power connections in the rack simultaneously, as it is technically not possible to replace the fuses for individual phases one after the other according to the datacenter provider.**Impact**\- Duration: 15-20 minutes - Region: fra1 - Affected Systems: All baremetal servers, public and private cloud in fra1 - Start: Dec 14, 21:55 CET - End: Dec 14, 22:20 CET**No Action Required**We will initiate a controlled shutdown of all fra1 services at 21:55 CET. Services in other regions (mep1, spo1) will not be impacted. We apologize for the short notice and inconvenience. This critical maintenance will prevent future power incidents and ensure long-term stability. Our team is available to assist with any concerns throughout the entire maintenance window. If you have any questions or concerns, please don't hesitate to reach out to us..

Dec 14, 20:58:27 GMT+0
Identified - The maintenance is in progress.

Dec 14, 22:10:00 GMT+0
Completed - The maintenance has been completed. The total downtime has been around 57 minutes. Our datacenter proider .

Affected Components: Virtualization Cluster Frankfurt, DE (FRA1)

Dec 5, 14:26:03 GMT+0
Resolved - At around 14:35 CET a power outage has occurred at our data centre in Frankfurt, Germany. Although the racks being powered by two different lines, it failed. While we are booting up all our customers Nodes within the next few minutes, we will investigate further why this has happened. Open support requests will be updated throughout the day. All affected customers will be contacted by us within the next few days to discuss this matter and apply compensation for the circumstances experienced. The situation is under control and nodes are booting again. Thanks for your understanding!.

Dec 5, 14:45:52 GMT+0
Resolved - All nodes are operational again. If you encounter any issues, please send an e-mail to [hi@v6Node.com](mailto:hi@v6Node.com) Total outage was 70 minutes. .

Duration: 15 hours and 22 minutes

Affected Components: Virtualization Cluster Spokane, US

Nov 27, 23:38:00 GMT+0
Identified - Due to a fiber cut, we are experiencing intermittent network connectivity issues at our US-West (Spokane) location. The upstream provider has dispatched a team to assess and repair the damage on-site. Currently, connectivity is being maintained by a backup transit via a separate circuit. However, due to congestion, some networks are still experiencing disruptions..

Nov 28, 15:00:01 GMT+0
Resolved - This incident has been resolved..

Duration: 12 hours and 45 minutes

Affected Components: Cloud Portal, Virtualization Cluster Frankfurt, DE (FRA1)

Nov 23, 22:15:00 GMT+0
Monitoring - We currently experience a outage in our edge routing, and investigating the situation. Our transit has been rerouted through another BGP transit provider. See: <https://status.dataforest.net/incidents/f0rgydm971v9>.

Nov 23, 22:45:00 GMT+0
Monitoring - The situation is under control and we are monitoring the transit routes. No degradation is expected..

Nov 24, 11:00:00 GMT+0
Resolved - This incident has been resolved. .

Duration: 4 hours and 29 minutes

Affected Components: Website , Cloud Portal, Virtualization Cluster Frankfurt, DE (FRA1)

May 14, 10:30:54 GMT+0
Identified - We are experiencing connectivity issues due to a power outage at InterXion FRA2\. This affects multiple providers connected to our FRA2 presence, both locally and through transport. Our team is working closely with suppliers to restore service as soon as possible. Thank you for your patience..

May 14, 11:16:50 GMT+0
Monitoring - We have implemented a fix by routing traffic over an alternative link and backhauling internet connectivity from our PoP in Meppel, NL. We are currently closely monitoring the situation..

May 14, 13:45:13 GMT+0
Monitoring - The first of our fibre paths connecting our infrastructure in Frankfurt has been restored, connectivity is performing as normal now. We continue to watch the situation as it evolves..

May 14, 15:00:00 GMT+0
Resolved - This incident has been resolved. Ever since May 14th 17:00 (Berlin time), all connectivity has been restored. Post mortem is to follow. .

Affected Components: Website , Cloud Portal, DNS Server, Virtualization Cluster Frankfurt, DE (FRA1)

Oct 25, 15:50:00 GMT+0
Resolved - We would like to inform you that one of our upstream providers recently encountered some technical challenges. Under normal circumstances, our backup transit provider would have ensured uninterrupted service. However, due to an earlier issue where legitimate traffic was mistakenly flagged as a DDoS attack by their anti-DDoS solution, this backup was temporarily disabled. We deeply regret any inconvenience caused and assure you that we are taking measures to enhance our network robustness. We are in the process of onboarding two additional transit providers by year's end. This will not only expand our overall network capacity but also diversify our network blend, further minimizing potential disruptions in the future. Thank you for your patience and understanding..

Affected Components: Virtualization Cluster Frankfurt, DE (FRA1)

Aug 17, 18:20:00 GMT+0
Resolved - Our monitoring systems have detected a partial loss of connectivity between 20:20 CEST and 20:30 CEST. We are actively monitoring the situation and will temporarily disable our sessions with a transit provider that appears to be contributing to this issue.

Duration: 20 minutes

Affected Components: Virtualization Cluster Frankfurt, DE (FRA1)

Jun 21, 13:30:00 GMT+0
Identified - A necessary kernel update will be performed today at 15:30 UTC+2, requiring a host reboot. The anticipated downtime is approximately 10 minutes. Only Nodes located on pve1 are affected..

Jun 21, 13:49:55 GMT+0
Completed - Maintenance has completed successfully..

Duration: 4 hours

Affected Components: Website , Cloud Portal, DNS Server, Virtualization Cluster Frankfurt, DE (FRA1)

May 26, 13:00:00 GMT+0
Identified - We would like to inform you about an upcoming maintenance event where we will be migrating our infrastructure to our primary location with MK Netzdienste. This move will provide a more energy-efficient and eco-friendly datacenter in Frankfurt. We will also be adding CDN77 and Meerfarbig to our upstream blend and upgrading our networking setup for future enhancements. The maintenance will occur on Friday, May 26th, during specific timeframes mentioned in the email. Our Cloud Panel and Frankfurt-hosted Nodes will be temporarily unavailable during this period. For further updates, please visit our status page at http://status.v6node.com. We apologize for any inconvenience caused and are available to address any concerns you may have..

May 26, 14:00:00 GMT+0
Identified - All servers have arrived in our new datacenter location and are currently being racked and powered up again by our service staff..

May 26, 17:00:00 GMT+0
Completed - Maintenance has completed successfully.

May 26, 13:00:01 GMT+0
Identified - Maintenance is now in progress.

May 26, 15:33:00 GMT+0
Identified - Maintenance will be extended until 07:00 pm as we are still making optimizations to the network infrastructure. We will inform you when the maintenance is finished and all services are available again..