Distributor GC CPU utilization is too high

[mymasse]

Since we upgraded to the mimir-distributed chart version 5.7.0 we've been getting the 'MimirDistributorGcUsesTooMuchCpu' alert on all our deployments. Looking at the release notes we can't see what could be causing this. The Runbook points out to horizontally scale the distributors but we're concerned there might be a bug somewhere because our metrics rates wouldn't have changed.

Should I raise an issue?

[mymasse]

OK I just dug more in the latest release notes and found: #10641. So I guess we've always had the problem and need to horizontal scale our distributors.

[aknuds1]

MimirDistributorGcUsesTooMuchCpu is a relatively new alert, which purpose is to catch when distributor GOMEMLIMIT causes too frequent garbage collection. The runbook has the details.