Some systems are experiencing issues

Core

Infrastructure

Operational

API

Operational

Git repositories

Operational

Deployments

Operational

Reverse Proxies

Operational

Logs

Drains

Partial Outage

Services Logs

Operational

Access Logs

Operational

Products

Cellar

Operational

SSH Gateway

Operational

VPN

Operational

MySQL shared cluster

Operational

Let's Encrypt certificate generation

Operational

MongoDB shared cluster

Performance Issues

Unique IP for outgoing traffic

Operational

RabbitMQ shared cluster

Operational

FS Buckets

Performance Issues

Console

Operational

PostgreSQL shared cluster

Operational

Elasticsearch

Operational

Customer support

Operational

Redis

Operational

Pulsar

Operational

Matomo add-on

Operational

PostgreSQL

Performance Issues

MySQL

Operational

Metrics

Operational

Heptapod Cloud

Operational

Other Components
cleverapps.io domains
Operational
Mails
Operational

Scheduled Maintenance

[PAR] Security maintenance on 4 hypervisors

For security reasons, we will update the kernel of 4 Hypervisors in the Paris (PAR) region, more precisely in the PAR6 datacenter. Services (in particular databases) hosted on those hypervisors will be impacted : they will be unavailable between 5 and 10 minutes. Impacted hypervisors are:

hv-par6-008 hv-par6-011 hv-par6-012 hv-par6-020

Affected clients are directly and individually contacted by email with the list of impacted services, and options to avoid any impact. The maintenance will be planned in 2 operations of 2 hypervisors each, during the week of 18 to 22 Novembre 2024 between 22:00 and 24:00 UTC+1.

Past Incidents

Saturday 9th May 2020

No incidents reported

Friday 8th May 2020

No incidents reported

Thursday 7th May 2020

No incidents reported

Wednesday 6th May 2020

No incidents reported

Tuesday 5th May 2020

No incidents reported

Monday 4th May 2020

Reverse Proxies One of the add-ons reverse proxies had to be rebooted

19:43 UTC: one of the add-ons reverse proxies stopped responding to a part of the requests. 19:45 UTC: We restarted it. Some still working connections were lost, but the reverse proxy is now operational.

Access Logs Metrics unavailable

Metrics cannot be read at the moment because of an issue with the index components.

A chunk and its replica are both non-responding which means the service as a whole is unavailable. We are working on it.

10:00 UTC: An index node being unavailable threw us off on the wrong track. Its replica was actually working just fine, the issue was with both front read nodes being stuck at the same time. We will improve monitoring and try to figure out what went wrong and why.

Sunday 3rd May 2020

No incidents reported