You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
hedeesaa opened this issue
Apr 24, 2025
· 0 comments
Labels
bugSomething that is supposed to be working; but isn'tclustersdashboardIssues specific to the Ray DashboardkuberayIssues for the Ray/Kuberay integration that are tracked on the Ray sidetriageNeeds triage (eg: priority, bug/not-bug, and owning component)usability
Grafana now supports displaying metrics from multiple clusters in a single dashboard. However, we've encountered a client-side issue where the iframe embeds don't pass the Cluster (cluster name) as a variable. This results in "No Data" or a fallback to the default cluster being shown in the Grafana panels.
For example, the ClusterUtilization panel in the Ray Dashboard references the Cluster variable:
Update the dashboard iframes on the client side to include the cluster name in the query string, e.g.:
&var-Cluster=${cluster}
Related Workaround Attempt:
PR ray#51396 attempted to address this by enabling the "Include All" option in the Grafana dashboard. However, the actual kuberay/config/grafana/* configs haven't been updated accordingly.
Suggestion:
Ensure the iframe logic in the dashboard client app sets the appropriate var-Cluster parameter, and update the kuberay/config/grafana templates to reflect the multi-cluster setup.
Versions / Dependencies
Ray version: 2.44.1
Reproduction script
--
Issue Severity
Medium: It is a significant difficulty but I can work around it.
The text was updated successfully, but these errors were encountered:
hedeesaa
added
bug
Something that is supposed to be working; but isn't
triage
Needs triage (eg: priority, bug/not-bug, and owning component)
labels
Apr 24, 2025
bugSomething that is supposed to be working; but isn'tclustersdashboardIssues specific to the Ray DashboardkuberayIssues for the Ray/Kuberay integration that are tracked on the Ray sidetriageNeeds triage (eg: priority, bug/not-bug, and owning component)usability
What happened + What you expected to happen
Issue:
We're running multiple Ray clusters in our Kubernetes environment. After the following merges:
Grafana now supports displaying metrics from multiple clusters in a single dashboard. However, we've encountered a client-side issue where the
iframe
embeds don't pass theCluster
(cluster name) as a variable. This results in "No Data" or a fallback to the default cluster being shown in the Grafana panels.For example, the
ClusterUtilization
panel in the Ray Dashboard references theCluster
variable:ray/python/ray/dashboard/client/src/pages/overview/cards/ClusterUtilizationCard.tsx
Lines 51 to 57 in 7beea56
Proposed Solution:
Update the dashboard iframes on the client side to include the cluster name in the query string, e.g.:
Related Workaround Attempt:
PR ray#51396 attempted to address this by enabling the "Include All" option in the Grafana dashboard. However, the actual
kuberay/config/grafana/*
configs haven't been updated accordingly.Suggestion:
Ensure the iframe logic in the dashboard client app sets the appropriate
var-Cluster
parameter, and update thekuberay/config/grafana
templates to reflect the multi-cluster setup.Versions / Dependencies
Ray version: 2.44.1
Reproduction script
--
Issue Severity
Medium: It is a significant difficulty but I can work around it.
The text was updated successfully, but these errors were encountered: