Some systems are experiencing issues

Past Incidents

Monday 30th October 2023

No incidents reported

Sunday 29th October 2023

No incidents reported

Saturday 28th October 2023

Reverse Proxies [PAR] public reverse proxies are experiencing issues

We are experiencing issues with Paris public reverse proxies.

These issues impact TLS and the ability to answer correctly.

EDIT 20:32 UTC - fixed.

Access Logs Metrics loadbalancer issue

We are detecting some errors on our newly metrics stack. We are on it.

Edit Sat Oct 28 14:51 2023 UTC: infrastructure have been scaled up, optimizations on LBs are underway, you may still experience errors during queries

Friday 27th October 2023

No incidents reported

Thursday 26th October 2023

Reverse Proxies [PAR] Load balancer maintenance

We have to update load balancer in the Paris region. We will remove dns one A record of load balancer, wait for the TTL, update the load balancer behind and then add the dns record back. If you are long running connection, they will be closed at the end of the TTL as we will stop the load balancer.

Edit 15:00 UTC : We start rolling the load balancer records for domain.par.clever-cloud.com

Edit 15:50 UTC : We have finished to do the rolling of the first ip address (46.252.181.103), next ones should be faster.

Edit 16:00 UTC: We have removed the second record (46.252.181.104), we are waiting for the ttl to expire before beginning

Edit 16:10 UTC: We have added back the second record (46.252.181.104), we are waiting for the ttl to expire before going further.

Edit 16:15 UTC : We have removed the third record (185.42.117.108 ) we are waiting for the ttl to expire before beginning

Edit 16:25 UTC: We have added back the third record ((185.42.117.108), we are waiting for the ttl to expire before going further.

Edit 16:30 UTC : We have removed the fourht and last one record (185.42.117.109 ) we are waiting for the ttl to expire before beginning

Edit 16:40 UTC : We have added back the third record ((185.42.117.109), we have finished the maintenance

Edit 17:38 UTC: We have an increase in TLS errors for incoming requests, we are looking into it.

Edit 18:08 UTC: We found a potential issue. We are deploying a fix and will monitor the situation closely.

Edit 19:06 UTC: The fix has been deployed since 18:55 and we are monitoring the situation

Edit D+1 16:00 UTC : We have find the issue on the update and patch the software. We will apply it in a few moment.

Edit D+1 16:30 UTC : We will update the first ip address 46.252.181.103.

Edit D+1 17:15 UTC : We have updated the second ip address 46.252.181.104, we will begin the third address 185.42.117.108.

Edit D+1 17:30 UTC : We have updated the fourth ip address 185.42.117.109.

Edit D+1 18:30 UTC : We have finished the operation, we are watching it

cleverapps.io domains cleverapps.io TLS unavailability

We are currently experiencing TLS requests issues on *.cleverapps.io domains. We are looking into the issue.

EDIT 13:00 UTC: The problem has been fixed and will be investigated further to pinpoint the origin. EDIT 13:30 UTC: We have applied a patch to solve the issue.

Deployments [Global] Deployment issue

There is an issue on the deployment stack. We have identified the issue and we have begun the recovery process.

07:34 UTC : we have fixed the issue and we keep watching the issue

13:00 UTC: The issue did not occur again. This incident is now over.

Wednesday 25th October 2023

No incidents reported

Tuesday 24th October 2023

No incidents reported