Some systems are experiencing issues

Past Incidents

Thursday 16th January 2025

[PAR] Network maintenance, scheduled 1 month ago

A network maintenance on the Paris region is planned on January 16th, 2025 between 21:30 UTC and 23:30 UTC. No service interruption or degradation is expected during this maintenance. We will update this incident throughout the operations.

EDIT 2025-01-16 21:27 UTC: The maintenance is about to start.

EDIT 2025-01-16 23:30 UTC: The maintenance is now over, no impact observed.

Wednesday 15th January 2025

Infrastructure [MTL] An hypervisor rebooted

An hypervisor rebooted on the MTL region. This hypervisor only hosts some of the FSBucket add-ons as well as some DEV MySQL add-ons. We are investigating the root cause and start restoring the service.

EDIT 16:45 UTC: The services are available again. The issue most probably comes from an ongoing electrical maintenance. This server was located in room B710: https://network.status-ovhcloud.com/incidents/m9fzvt0nd8jm. We will follow up with OVH to get more information. In the meantime, we'll keep an eye on the maintenance status.

Tuesday 14th January 2025

Grafana maintenance for update, scheduled 1 month ago

A maintenance is planned on Grafana starting at 9:00 Paris CET and expected to last for several minutes. We plan to upgrade the version of Grafana to v9.5.5.

EDIT 10:10 CET: The update completed successfully

Monday 13th January 2025

Cellar Paris: Service upgrade might increase requests latencies, scheduled 1 month ago

We are currently in the process of upgrading our Cellar Paris service. During this upgrade, customers might experience increased requests latencies when we restart certain components. No service interruption is to be expected. The upgrade should take place throughout the week starting on Monday 13/01/2025 around 09:00 UTC . We will update this maintenance once it is over or if anything comes up.

EDIT 2025-01-15 17:05 UTC: The maintenance is now over. No service interruption occurred.

Sunday 12th January 2025

No incidents reported

Saturday 11th January 2025

No incidents reported

Friday 10th January 2025

Console Viewing a MateriaKV add-on can disconnect the user

16:50 UTC: We identified an issue where the user can be disconnected if the user try to see add-on informations of a MateriaKV. We are working on a fix.

EDIT 17:05 UTC: A fixed is deployed, if any disconnection happens, please inform the support.

Reverse Proxies [SGP] load balancer connectivity issues with configuration event bus

Load balancers are experiencing connectivity issues with the event bus when retrieving configuration; we are investigating.

EDIT 10:00 UTC : it seems that the issue is due to packets losse between SGP region and PAR region, we are investigating.

EDIT 11:00 UTC : the incident is related to an AS which is not in our network, we have contacted our network providers to mitigate the issue.

RabbitMQ shared cluster [Paris] Shared RabbitMQ service is experiencing degraded performances

The shared RabbitMQ cluster on the Paris region is experiencing intermittent degraded performances. We are investigating.

EDIT 10:27 UTC: The underlying issue has been found, a RabbitMQ client was reconnecting too fast / too often leading to a global increase of load on the cluster. The situation has been addressed. We continue to monitor the situation.

EDIT 2025-01-13 09:45 UTC: The situation is back to normal since 10/01/2025 10:30 UTC. The incident is over.

Thursday 9th January 2025

No incidents reported