Notice #506724
Recovering

Intermittent Network Connectivity Issues

Began:

All customer applications and services are reachable and operating normally.

Cockpit and Ticketing System may still show temporary limitations until fully recovered. We continue to monitor the situation closely and will provide further update accordingly.

Thank you for your patience, and we apologize for any inconvenience caused.

We have adjusted our mitigations and are monitoring the situation. Things currently appear more stable, and Cockpit login should be working again. The attack is still ongoing, so interruptions remain possible. We will post another update as soon as the situation changes.

Thank you for your patience while we work through this.

The malicious traffic targeting our infrastructure is ongoing and we are working on various mitigations.

Login to Cockpit is currently affected. Applications and Services may also be intermittently reachable (flapping up and down) while mitigation work continues.

We will post another update as soon as the situation changes.

We are continuing to respond to the ongoing malicious traffic targeting deplo.io infrastructure. Active mitigation work remains in progress. If you're still having issues with your deplo.io app, please reach out to support@nine.ch.

We are continuing to respond to the ongoing malicious traffic targeting deplo.io infrastructure. Active mitigation work remains in progress, and affected applications are still temporarily unavailable.

Due to a large volume of malicious traffic targeting parts of the deplo.io infrastructure, some applications are currently unavailable.

Mitigation is in progress. We will post another as soon as the situation changes.

  • General
  • Virtualization
  • Managed Kubernetes
  • Network
  • External
  • E-Mail
  • Deploio
Previous Incidents

[] Scheduled maintenance – deplo.io

Began: Ended: Duration:
  • Deploio

We're performing planned maintenance on the traffic-routing layer of deplo.io. During the window, each application may experience a brief interruption (up to a few minutes) as its traffic is moved to the upgraded infrastructure. Connections are restored automatically — no action is required on your side.

Your application URLs, custom domains and TLS certificates remain unchanged.

This maintenance has been cancelled due to the DDoS attack from yesterday. We will move this maintenance a couple of weeks, you will get notified again when we schedule the new maintenance. Thank you for your patience.

[Resolved] Intermittent Network Connectivity Issues

Began: Ended: Duration:
  • General
  • Virtualization
  • Managed Kubernetes
  • Network
  • Deploio

We are currently experiencing a network incident that may cause connectivity issues and affect the availability of our services.

We're currently seeing increased traffic on a small number of IP addresses. We're monitoring the situation and will update here with further information.

We've now resolved the incident. Thanks for your patience.

[Resolved] Network Connectivity Issues

Began: Ended: Duration:
  • General
  • Managed Kubernetes
  • Network
  • Deploio

We are currently experiencing a network incident that may cause connectivity issues and affect the availability of our services.

We are investigating the cause and working to resolve the issue. We apologize for any inconvenience caused and will provide further updates as soon as more information becomes available.

We are currently experiencing connection failures affecting access to our services. We have identified a large volume of malicious traffic saturating our network links and are working on mitigating the issue.

We will post another update when the situation changes.

We have started blocking the malicious traffic and our network is starting to recover. Some users may still see elevated latency or intermittent errors while capacity returns to normal. Our team is actively working to bring the situation fully under control.

The issue has been resolved and our network is operating normally. Traffic levels have been stable for a sustained period.

We are continuing to monitor the network and are prepared to act immediately if the situation changes. Thank you for your patience during the disruption.

[Complete] Maintenance of the CZ41 Virtualization Infrastructure

Began: Ended: Duration:
  • Virtualization

We will be performing scheduled maintenance on our CZ41 virtualization environment. No customer impact is expected during this maintenance window.

We appreciate your understanding and will inform you once the maintenance is complete.

The scheduled maintenance is now underway. We'll keep you updated on our progress.

The maintenance is now complete. Thanks for your patience.

[Resolved] [NKE] new nodes are having issues being spawened

Began: Ended: Duration:
  • Managed Kubernetes

New nodes currently cannot be spawned. Existing nodes are working. Autoscaling nodes, manual scaling nodes and new cluster nodes cannot be created right now.

We've now resolved the incident. Thanks for your patience.

[Complete] Maintenance of the ES34 Virtualization Infrastructure

Began: Ended: Duration:
  • Virtualization

We will be performing scheduled maintenance on our ES34 virtualization environment. No customer impact is expected during this maintenance window.

We appreciate your understanding and will inform you once the maintenance is complete.

The scheduled maintenance is now underway. We'll keep you updated on our progress.

The maintenance is now complete. Thanks for your patience.

[Resolved] [Self-Service] New IP address / Static Egress reservations are stuck and not being provisioned.

Began: Ended: Duration:
  • General
  • Managed Kubernetes
  • Network

We are looking into the issue. Existing IPs will continue to work.

We've confirmed there is a problem, we're working to resolve it.

We've fixed the core issue, and are waiting for things to recover.

We've now resolved the incident. Thanks for your patience.

[Complete] Virtual Infrastructure Maintenance Root VServer and CloudVM

Began: Ended: Duration:
  • Virtualization

To continuously operate our virtual infrastructure safely, a critical maintenance configuration change needs to be scheduled to apply a mitigation. This affects all Root VServers and CloudVMs with the product type "CloudVM C*" (newer CloudVMs, assignable to projects and which product names like nine-* are not affected).

During this maintenance, all virtual machines need to be stopped, including the virtualization host, and then started again. The individual downtime will be shorter than the scheduled window.

The scheduled maintenance is now underway.

The maintenance is now complete. Thanks for your patience.

[Resolved] [S3] Location es34 connection issues

Began: Ended: Duration:

All buckets in es34 are affected and all services that use S3 are affected. Including: Loki, Docker Registry

We are investigating and will get back to you

Buckets are reachable again. We are still investigating the root cause together with the vendor and monitoring the situation. Once we are confident the issue is fully resolved, we will post a final update. If you continue to experience issues, please reach out to support.

We have identified the root cause: a process [in the storage layer] got stuck, and a reboot was required to restore service. Together with the vendor, we are improving the monitoring for this component and have defined a playbook to resolve similar issues faster in the future. There is currently no indication that this issue will re-occur. We consider this incident resolved.

The issue arose again. We are in contact with the vendor.

Our deepest apologies. We are working hard to resolve the issue asap.

Further investigation revealed an additional potential cause. We will apply a fix and closely monitor the situation. Once the systems remain stable over the next 24 hours, we will mark this incident as resolved.

Service availability has recovered. However, we are observing higher latency than usual. The incident remains open while we work with the vendor to identify the cause, and we will update once we know more.

Since our last update on 17. July 2026, the service has remained stable with no further issues regarding latency or availability. The systems have been running without anomalies for several days. We are therefore marking this incident as resolved.

If you have any questions, please don't hesitate to reach out to us at support@nine.ch.

No further notices from the past 30 days.