Some systems are experiencing issues

Core

Infrastructure

Operational

API

Operational

Git repositories

Operational

Deployments

Operational

Reverse Proxies

Operational

Logs

Drains

Partial Outage

Services Logs

Operational

Access Logs

Operational

Products

Cellar

Operational

SSH Gateway

Operational

VPN

Operational

MySQL shared cluster

Operational

Let's Encrypt certificate generation

Operational

MongoDB shared cluster

Performance Issues

Unique IP for outgoing traffic

Operational

RabbitMQ shared cluster

Operational

FS Buckets

Performance Issues

Console

Operational

PostgreSQL shared cluster

Operational

Elasticsearch

Operational

Customer support

Operational

Redis

Operational

Pulsar

Operational

Matomo add-on

Operational

PostgreSQL

Performance Issues

MySQL

Operational

Metrics

Operational

Heptapod Cloud

Operational

Other Components
cleverapps.io domains
Operational
Mails
Operational

Scheduled Maintenance

[PAR] Security maintenance on 4 hypervisors

For security reasons, we will update the kernel of 4 Hypervisors in the Paris (PAR) region, more precisely in the PAR6 datacenter. Services (in particular databases) hosted on those hypervisors will be impacted : they will be unavailable between 5 and 10 minutes. Impacted hypervisors are:

hv-par6-008 hv-par6-011 hv-par6-012 hv-par6-020

Affected clients are directly and individually contacted by email with the list of impacted services, and options to avoid any impact. The maintenance will be planned in 2 operations of 2 hypervisors each, during the week of 18 to 22 Novembre 2024 between 22:00 and 24:00 UTC+1.

Past Incidents

Sunday 20th October 2024

Pulsar Pulsar cluster is an unhealthy state

The monitoring report that pulsar is in a unhealthy state, we are investigating.

16:38 UTC: there seems to be an inconsistency in the underlying bookkeeper cluster. We are looking into it.

16:40 UTC: we are now looking into the zookeeper service that seems to fail.

17:30 UTC: we have fix the zookeeper issue, and we begin the recovery process of the cluster bookeeper and then pulsar.

18:10 UTC : we are rolling open the access to the pulsar cluster.

18:45 UTC : we have rolled open the access to the pulsar cluster to half of our hypervisors.

19:15 UTC : the pulsar cluster is running and available for everyone. We are running the recovery process of the platform to ensure that every applications is up and running as well.

21:30 UTC : we have finished to redeploy applications. We are investigating the access logs stack that got offloaders errors on pulsar-side.

22:10 UTC : we have finished to restart the access logs stacks.

Saturday 19th October 2024

No incidents reported

Friday 18th October 2024

No incidents reported

Thursday 17th October 2024

No incidents reported

Wednesday 16th October 2024

No incidents reported

Tuesday 15th October 2024

No incidents reported

Monday 14th October 2024

No incidents reported