We are seeing elevated error rate for metrics queries due to the underlying storage system. The problem has been identified and we are working toward its resolution. This can impact some of the grafana dashboards or API queries.
EDIT 09:44 UTC: The issue is not fully resolved yet but we are seeing improvements. We continue working on the issue.
EDIT 11:04 UTC: Queries are now working since 10:15 UTC, we continue monitoring to ensure everything is working as intended.
EDIT 15:43 UTC: Everything is back to normal, this incident is now over.