Past Incidents

Saturday 22nd April 2023

No incidents reported

Friday 21st April 2023

No incidents reported

Thursday 20th April 2023

Deployments Deployments instability: VM stuck in STOPPING state

Some VMs are currently stuck in the STOPPING state. We are investigating.

EDIT 8:00 AM UTC: VMs are no longer stuck.

Reason: a bad user found a way to start a lot of huge instances and run resource-heavy cryptomining operations. It loaded the hypervisors and made some APIs unresponsive. We blocked them and took actions to prevent future abuse of our service.

Wednesday 19th April 2023

No incidents reported

Tuesday 18th April 2023

Access Logs Metrics and access logs queries are experiencing issues

Metrics and access logs (through Grafana, the Web Console or the API) are experiencing either slowness or missing data. We are currently looking into it.

EDIT 10:40 AM UTC: We have found the issue and we are currently fixing it.

EDIT 04:01 PM UTC: The issue is resolved

Deployments Deployments are stucks and infrastructure instabilities

Deployments are currently stuck, preventing users from deployment their applications. Other parts of the infrastructure are currently experiencing instabilities.

EDIT 09:35 UTC: The problem should now be mostly resolved. Some services might still have troubles, dedicated incidents will be opened. We continue monitoring the situation.

Monday 17th April 2023

No incidents reported

Sunday 16th April 2023

No incidents reported