Past Incidents

Wednesday 20th June 2018

Access Logs Metrics problem

Metrics are experiencing issues.

Tuesday 19th June 2018

Logs collector restart, scheduled 6 years ago

The logs collector needs to be restarted. Some logs might be lost for one to two minutes.

EDIT 22:00 UTC: Restart took approximately 30 seconds, most applications sent again the logs they couldn't send during that time

Monday 18th June 2018

Infrastructure HV down

HV is down/unreachable. There seems to be a hardware problem. We are investigating it.

Some databases are unreachable.

EDIT 2018-06-18T23:25:00 UTC: Seems to be a malfunctioning fan. The server is still down for investigation. We are waiting for more informations from our hypervisor provider. EDIT 2018-06-19T00:37:00 UTC: The malfunctioning fans have been replaced. The server is up again. All the databases are up and running.

Infrastructure A hypervisor is down/unreachable.

Some databases are unreachable.

EDIT 2018-06-18 16:29 UTC: The hypervisor is up again, the databases are getting back up.

Applications that were on this HV were redeployed on another one.

Sunday 17th June 2018

No incidents reported

Saturday 16th June 2018

No incidents reported

Friday 15th June 2018

No incidents reported

Thursday 14th June 2018

Infrastructure Network instabilities on *.cleverapps.io on the Paris zone

We have detected some network instabilities on one of our reverse proxy of the *.cleverapps.io domain, affecting the Paris zone. Our network provider has been notified.

EDIT 15:08 UTC: We are still waiting for our network provider to find the root cause of it.

EDIT 15-06-18 13:00 UTC: Instabilities have ceased since this morning. Everything should be back to normal

Infrastructure Rabbitmq shared crashed

One of the nodes of the shared rabbitmq cluster went down. We are bringing it back

EDIT 10:40 UTC: The node has been restarted, we continue to monitor the situation.

EDIT 13:20 UTC: The cluster has been running fine since the incident