Some systems are experiencing issues

Past Incidents

Sunday 22nd December 2024

No incidents reported

Saturday 21st December 2024

No incidents reported

Friday 20th December 2024

No incidents reported

Thursday 19th December 2024

No incidents reported

Wednesday 18th December 2024

No incidents reported

Tuesday 17th December 2024

Access Logs Access logs ingestion pipeline issue

The processing components of the access logs pipeline have a bug that prevent us to process the access log properly. We are currently investigating the issue.

EDIT 14:50 UTC : We found the bug and a patch that comes with. We have deployed the path in production and we are processing access logs queues.

EDIT 10:15 UTC : The access logs have been completely consume, we are processing on the fly since yesterday 18: 45 UTC.

[RBX] Hypervisor crashed

(Times in UTC) An hypervisor has crashed on the RBX region. Applications that were running on this hypervisor are currently redeploying. We are investigating the reason of the crash.

  • 00:35: it looks like the kernel went rogue. We are rebooting the server
  • 00:45: The server was successfully rebooted, we are starting to check that all the services are restarting correctly.
  • 00:55: Everything is back to normal. All databases are up and running.
Grafana maintenance planned, scheduled 4 days ago

A maintenance is planned on Grafana starting at 21:00 Paris CET and expected to last for 1 hour

[ 01:00 CET] Maintenance is now completed

Monday 16th December 2024

No incidents reported