Past Incidents

At the moment we are facing storage issues in region DBL. Some IO requests may take longer than usual.

We will keep you informed and apologise for any inconveniences.

Currently we are facing issues with the SysEleven Stack API in the DBL Region. We are working on a solution and keep you informed.

The outage only affects spawning new virtual machines or changing existing resources.

We apologise for any inconveniences.

UPDATE 00:30:

We have identified the cause of the API issues in DBL and resolved the issues for most API operations.

Due to a bug in OpenStack API components, the DBL API services used CBK identity URLs for validating tokens, which did not work due to the planned maintenance.

We changed all internal identity URLs in the endpoint registry to region-agnostic URLs.

We are now working on fully resolving this issue for all API operations in DBL.

UPDATE 00:50: All issues are resolved.

Currently it will take a long time to create servers with the Local SSD Storage (L1.*) flavors. The wait time increases linearly to Local SSD Storage capacity of the chosen flavor. Eventually, creating the server will succeed.

This is due to a mitigation we put in place that solves sporadic performance problems, when a virtual machine has been created or deleted. We are right now working on a better mitigation, that will not affect creating servers.

The issue only affects spawning new virtual machines with the L1.* flavor (Local SSD Storage).

We apologise for any inconveniences.

UPDATE 2019-02-13: The issues are fully resolved now. Creating and deleting Local SSD Storage instances will only take a few seconds now, and the time for creating and deleting VMs is constant, no matter what disk capacity.