Some systems are experiencing issues
Scheduled Maintenance
[PAR] Security maintenance on 4 hypervisors

For security reasons, we will update the kernel of 4 Hypervisors in the Paris (PAR) region, more precisely in the PAR6 datacenter. Services (in particular databases) hosted on those hypervisors will be impacted : they will be unavailable between 5 and 10 minutes. Impacted hypervisors are:

hv-par6-008 hv-par6-011 hv-par6-012 hv-par6-020

Affected clients are directly and individually contacted by email with the list of impacted services, and options to avoid any impact. The maintenance will be planned in 2 operations of 2 hypervisors each, during the week of 18 to 22 Novembre 2024 between 22:00 and 24:00 UTC+1.

Past Incidents

Sunday 3rd December 2023

Infrastructure Hypervisor in SCW crashed

An hypervisor in the SCW region crashed. We restarted it.

Some databases went unavailable, We are checking that they all rebooted correctly.

EDIT 15:51 UTC: all checks have completed. All the services are operational.

EDIT 04/12/2023 11:00 UTC : It seems that the load balancer behind the ip 212.129.27.183 was impacted by the incident. The issue is solved.

Saturday 2nd December 2023

Reverse Proxies [SCW] A database reverse proxy went unresponsive for 3 minutes

16:44 UTC: one of the reverse proxy for databases became unresponsive on SCW. We restarted it. 16:47 UTC: the reverse proxy has restarted and is working again.

Consequences: some applications on SCW may have lost connection to their database for a few minutes. They may have crashed and been redeployed by our monitoring.

Friday 1st December 2023

No incidents reported

Thursday 30th November 2023

No incidents reported

Wednesday 29th November 2023

API API seems to be slow

Our main API responds slowly. We are investigating to find out why.

EDIT 19h UTC : The issue has been solved

[Paris] Datacenter update, scheduled 10 months ago

We are planning to do various updates on one of our datacenter in the Paris region starting at 13:30 UTC. It will last for a few hours. No issue is to be expected during this window.

We will update this status accordingly.

EDIT 17:30 UTC: All updates are now over. Operations went smoothly and no impact was detected.

Tuesday 28th November 2023

No incidents reported

Monday 27th November 2023

Reverse Proxies TCP redirections unavailable

In our efforts to fix the issues listed in this status, we fully moved our trafic from the old LB running sōzu 0.13 to new LBs running sōzu 0.15 at 13:30 UTC.

While performing the move, a network configuration issue arose, impacting only customers using TCP redirections on the PAR region.

As the team was focused on monitoring and fine-tuning the configuration of the new LB, it failed to see the error reports until 14:30 UTC. To prevent such an incident in the future, we have since improved our monitoring and alert tools for TCP redirects.

The issue was fixed by 14:55 UTC.

Trouble to access addons Metrics

We detected an issue to both access and ingest Clever-cloud applications and addons metrics.

We are investigating.

Edit 27 Nov 2023 11:02:23: Query is now functional. We are also observing an issue with metrics from add-ons. We are on it. Edit 27 Nov 2023 06:00 PM: A regression on token's regen has been fixed, and all tokens have been updated.

[Paris] Datacenter update, scheduled 10 months ago

We are planning to do various updates on one of our datacenter in the Paris region starting at 14:00 UTC. It will last for a few hours. No issue is to be expected during this window.

We will update this status accordingly.

EDIT 23:15 UTC: All updates are now over. Operations went smoothly and no impact was detected.