Past Incidents

Affected Components: SysEleven Stack Networking in region FES

Scheduled Start: 6 Feb 2023, 22:00 CET

Scheduled End: 7 Feb 2023, 01:00 CET

State: SCHEDULED

Description:

We will update the networking software (SDN).

Customer Impact during the Maintenance:

• interruption of connectivity of virtual machines of up to 2 minutes
• VPN connections could be interrupted for up to 2 minutes

Customer Actions:

• no customer actions needed
• please inform us if you notice any irregularities

Affected Components: F5 Loadbalancer, BKI

Incident Start: 1st Feb. 2023/15:35 Incident End: 1st Feb. 2023/16:15

Description:

• Malfunction of our F5 Cluster in BKI caused by http2

Customer Impact:

• Affected customers will see downtimes and/or flapping availabilty for their websites
• Affected customers were notified via E-Mail
• HTTP2 functions will be unavailable

Update 15:42: A fix was applied to prevent the cluster from crashing, HTTP2 has been disabled for all customers on the F5 Loadbalancer in BKI

Update 15:55: The cluster is running stable with the deployed fix. HTTP2 is still disabled.

Update 16:15: The cluster is still stable, so we declare this incident resolved. HTTP2 will stay disabled until further notice.

Affected Components: SysEleven Stack, identity service (Keystone)

Scheduled Start: 25. Jan. 2023/22:00

Scheduled End: 26. Jan. 2023/00:00

State: COMPLETED

Description:

• Scheduled maintenance of our SysEleven Stack identity service (Keystone)
• We will update Keystone to a new version during this maintenance

We do not expect customer impact during the maintenance.

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities

Update: 23:15 We completed the maintenance, observed a minor Keystone slowdown from 22:15 to 22:25.

Affected Components: SysEleven Stack, region CBK

Incident Start: 13 Jan 2023, 09:43 Incident End: 13 Jan 2023, 09:50

Description:

• Block storage I/O was slow in region CBK between 9:43 and 9:50.

Customer Impact:

• I/O performance for block storage of VMs (shared-storage main disks or volumes) was degraded which could lead to stalled system operations.

Affected Components: SysEleven Stack, identity service (Keystone)

Scheduled Start: 11. Jan. 2023/22:00

Scheduled End: 12. Jan. 2023/00:00

State: COMPLETED

Description:

• Scheduled maintenance of our SysEleven Stack identity service (Keystone)
• We will update Keystone to a new version during this maintenance

We do not expect customer impact during the maintenance.

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities

Update:

11:15 PM: We completed the maintenance, we did not encounter any obstacles.

Affected Components: NFS, Datacenter BLU

Scheduled Start: 9. Jan. 2023/11:00 pm

Scheduled End: 10. Jan. 2023/02:00 am

State: SCHEDULED

Description:

In order to ensure the stability of the NFS Service we will carry out maintenance work on the storage appliances at the location Berlin Lützowstraße (BLU) on January 10th 2023 from 11:00 pm to 2:00 am..

Customer Impact during the Maintenance:

• Scheduled maintenance of our NFS service (datacenter Lützowstrße)
• During the maintenance work, the cluster nodes will be individually removed from the network and restarted. Existing client connections are swivelled onto the active cluster nodes
• NFS Service in Datacenter Lützowstraße (Blue) might be interrupted due to connection timeouts

Customer Actions:

• No customer actions needed
• Please inform us if you notice any irregularities