Some systems are experiencing issues

Core

Infrastructure

Operational

API

Operational

Git repositories

Operational

Deployments

Operational

Reverse Proxies

Operational

Logs

Drains

Partial Outage

Services Logs

Operational

Access Logs

Operational

Products

Cellar

Operational

SSH Gateway

Operational

VPN

Operational

MySQL shared cluster

Operational

Let's Encrypt certificate generation

Operational

MongoDB shared cluster

Performance Issues

Unique IP for outgoing traffic

Operational

RabbitMQ shared cluster

Operational

FS Buckets

Performance Issues

Console

Operational

PostgreSQL shared cluster

Operational

Elasticsearch

Operational

Customer support

Operational

Redis

Operational

Pulsar

Operational

Matomo add-on

Operational

PostgreSQL

Performance Issues

MySQL

Operational

Metrics

Operational

Heptapod Cloud

Operational

Other Components
cleverapps.io domains
Operational
Mails
Operational

Scheduled Maintenance

[PAR] Security maintenance on 4 hypervisors

For security reasons, we will update the kernel of 4 Hypervisors in the Paris (PAR) region, more precisely in the PAR6 datacenter. Services (in particular databases) hosted on those hypervisors will be impacted : they will be unavailable between 5 and 10 minutes. Impacted hypervisors are:

hv-par6-008 hv-par6-011 hv-par6-012 hv-par6-020

Affected clients are directly and individually contacted by email with the list of impacted services, and options to avoid any impact. The maintenance will be planned in 2 operations of 2 hypervisors each, during the week of 18 to 22 Novembre 2024 between 22:00 and 24:00 UTC+1.

Past Incidents

Friday 31st July 2020

No incidents reported

Thursday 30th July 2020

No incidents reported

Wednesday 29th July 2020

Access Logs Metrics ingestion and reading issue

The Metrics platform is unavailable at the moment due to an issue with the storage backend. We are investigating.

16:23 UTC: Some storage nodes were misbehaving. The issue is now fixed: reads are functional again and ingestion is now catching up.

16:28 UTC: Ingestion delay has been divided by two, incident should be over in under 10 minutes.

16:28 UTC: Incident is over.

Tuesday 28th July 2020

No incidents reported

Monday 27th July 2020

Access logs unavailability

Access logs are currently unavailable to query. Activity maps in the console may show outdated data. Querying old access logs works fine, only newer logs aren't processed for now.

EDIT 13:27 UTC: all access logs should be available again since 12:50 UTC. The root cause has been identified and will be addressed. Some logs may have been lost during that timeframe.

Sunday 26th July 2020

No incidents reported

Saturday 25th July 2020

No incidents reported