GrafanaMimir Alertmanager Datasource not working #8065
Unanswered
MarcelGlaub
asked this question in
Help and support
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone, I have problems with creating Mimir alerts.
My setup:
MinIO VM as S3 storage backend
One Kubernetes Cluster with Prometheus remote writing metrics to Mimir
A second Kubernetes Cluster running GrafanaMimir and Consul
Grafana v10.0.3
Mimir 5.0.0
First of all, I have my normal datasource via which I receive the metrics from Prometheus. The datasource works for querys and visualizing metrics in grafana. As soon as I go to AlertRules i get an error saying

Failed to load the Datasource configuration for Mimir: Failed to fetch
but the Datasource is still there for selection:Then I actually have an Alertmanager Datasource, configured like this:
Health check passes but the datasource is not displayed in AlertRules. If I put /alertmanager after the url I get the following error during the health check:
It looks like you have chosen a Mimir or Cortex implementation, but detected a Prometheus endpoint. Please update implementation selection and try again.
But then when i put /alertmanager after the url and change the Implementation to Prometheus the HealthCheck Passes again.
So to summarize: I don't understand how the config should look so that a datasource is displayed here in grafana as a Mimir datasource

I have tried what feels like all the possibilities. I also find the documentation quite confusing. for example: The documentation says to use the /prometheus prefix:
https://grafana.com/docs/grafana/latest/alerting/alerting-rules/create-mimir-loki-managed-rule/
and in turn it says that you should use /alertmanager:
https://grafana.com/docs/mimir/latest/references/architecture/components/alertmanager/
I can't see any errors in the grafana/ruler/alertmanager pod logs. I have configured ruler api, and external urls as described in the docs.
My value files:
mimir_values.yaml.txt
grafana_values.yaml.txt
I would be very grateful for suggestions 😃
Cheers
Marcel
Beta Was this translation helpful? Give feedback.
All reactions