All systems are operational

Past Incidents

11th May 2020

No incidents reported

10th May 2020

No incidents reported

9th May 2020

Some apps in "suspended" state (FRA01)

During our emergency maintenance, we were finally able to restore the state of the IP database. Unfortunately it seems that in some cases containers did not get automatically started after the maintenance.

We are currently investigating if we can find the affected containers and start them for our customers. If you encounter a container in "suspended" state, feel free to start it yourself.

8th May 2020

Emergency maintenance (FRA01), scheduled 3 weeks ago

Since yesterday we are facing issues with our IP address allocation system which is responsible for assigning IP addresses to containers. Due to what we think a split-brain, this system is inconsistent state causing it to function improperly.

So far we have done anything possible to repair the situation, without affecting the runtime of our containers. But after 24 hours of debugging we have to come to the conclusion that probably the only way is to get out this situation is to reinitialize every node in the affected cluster meaning we have to move all running containers to other nodes.

Normally moving containers between nodes will hardly be noticed, but as we expect to do it multiple times there is a good change your applications will be affected by this.

This evening at 23:00, Central European Time (CET) we will start the operation, causing your containers to be restarted once or multiple times. As there are a lot of containers to be restarted we cannot be sure how long this will take, but we do everything within our power to get the platform into the correct state again.

We sincerely apologize for any inconvenience caused and that we have to perform this emergency maintenance on such a short notice without a proper announcement.

7th May 2020

Deployment failures (FRA01)

We are experiencing issues with restart of containers and new container deployments on our Frankfurt platform. There seems to be a issues relating to a inconsistency in the internal IP database which we are trying to solve.

Until the issue is solved, we ask prevent restarting or deploying any new containers until the issue is solved completely. As this can result in the action being delayed or not able to complete at all.

We apologies for any inconvenience caused.

6th May 2020

No incidents reported

5th May 2020

No incidents reported