Past Incidents

Wednesday 8th November 2023

API APIs are experiencing issues

We are seeing issues with our APIs. We are investigating this.

Edit 2023-11-09 : we are keeping this incident open as the performance issues seem to have lowered but not vanished. There seems to be a seasonality with these issues, we are still searching why we have these surges in load.

Cellar [Cellar] random lag on Cellar connections

Customers have complained about slow request handling on Cellar for a few days. On random requests, Cellar might take up to a few seconds to send the first byte.

We are investigating this issue.

Tuesday 7th November 2023

API Main API connectivity issues

We have difficulties to reach our main api (api.clever-cloud.com). We are investigating.

EDIT 16:30 UTC : The main api is reachable, we are investigating the root cause which may seems related to the database.

EDIT 16:40 UTC : We have detected that we missed of capacity on the database, we have update the capacity and reboot the database, we are deploying the api again.

EDIT 18:00 UTC : The main api is reachable

Infrastructure Hypervisor on RBX region went down.

One hypervisor went down on rbx region. We are trying to reboot it.

All the applications on that HV are being redeployed. A few add-ons that are on it are unavailable.

The hypervisor was not rebooting from our OVHCloud interface. We asked the support and they put it back up again.

12:28 UTC: the HV is running, we are starting the cleaning procedure and making sure all the add-ons have restarted correctly.

Monday 6th November 2023

API Main API connectivity issues

Our main api is encountering issues while loging into our database. It may make some requests fail in a random manner. We are investigating it.

Access Logs Accesslogs are not retrievable

The accesslogs APIs are having issues. We are working on it.

All the access logs are still stored, but the API will not give you the recent ones (up to two weeks).

Edit 2023-11-14: we are still working on making the accesslogs available from the API.

Sunday 5th November 2023

No incidents reported

Saturday 4th November 2023

No incidents reported

Friday 3rd November 2023

Reverse Proxies Reverse proxies for cleverapps.io are desync

Some cleverapps.io domain might display 404 or 503 instead of the actual website they should point to. We are reloading the reverse proxies configuration.

update 08:40 UTC - the reverse proxies have been resynchronized. We are watching it and looking for the reason of the desynchronization.

Thursday 2nd November 2023

Deployments Deployments are not working correctly

Due to an issue with our message broker, deployments are acting up. We are investigating.

Update 20:04 UTC - We have fixed the broker issue and restarted every service that failed to reconnect. The situation is back to normal.