Skip to content

Update Ray Data histograms to show percentiles in data dashboard#58650

Merged
alanwguo merged 7 commits into
ray-project:masterfrom
alanwguo:update-histograms
Nov 18, 2025
Merged

Update Ray Data histograms to show percentiles in data dashboard#58650
alanwguo merged 7 commits into
ray-project:masterfrom
alanwguo:update-histograms

Conversation

@alanwguo

@alanwguo alanwguo commented Nov 14, 2025

Copy link
Copy Markdown
Contributor

Description

The data grafana dashboard by default should work well when viewing across all operators. Use a percentile graph that is grouped by operator instead.

For the histogram bar charts, hide that in the operator panels row. This is useful for areas where we by default filter by a single operator (like in the data dashboard)

Screenshot 2025-11-14 at 2 33 16 PM Screenshot 2025-11-14 at 2 33 08 PM
Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo requested a review from a team as a code owner November 14, 2025 22:22

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request is a great initiative to improve the data dashboard by replacing histograms with P90 percentile graphs for key metrics, which should provide more actionable insights. The old histogram views are thoughtfully preserved within a collapsed "Operator Panels" row for detailed, per-operator analysis.

My review has identified a critical issue in the new PromQL queries for percentile calculations that would render the graphs incorrect. I've provided specific code suggestions to fix this. Additionally, I've included a couple of medium-severity comments to enhance code maintainability by addressing code duplication and removing unused code.

Comment thread python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py Outdated
Comment thread python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py Outdated
Comment thread python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py Outdated
Comment thread python/ray/dashboard/modules/metrics/dashboards/data_dashboard_panels.py Outdated
Alan Guo added 2 commits November 14, 2025 14:33
Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: Alan Guo <aguo@anyscale.com>
@ray-gardener ray-gardener Bot added docs An issue or change related to documentation data Ray Data-related issues observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling labels Nov 15, 2025
@bveeramani bveeramani self-assigned this Nov 16, 2025
Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo added the go add ONLY when ready to merge, run all tests label Nov 17, 2025
@alanwguo alanwguo requested a review from a team as a code owner November 18, 2025 01:22
Comment thread python/ray/dashboard/modules/metrics/grafana_dashboard_factory.py Outdated
Signed-off-by: Alan Guo <aguo@anyscale.com>
@alanwguo alanwguo merged commit 9ffdd76 into ray-project:master Nov 18, 2025
6 checks passed
SheldonTsen pushed a commit to SheldonTsen/ray that referenced this pull request Dec 1, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
…-project#58650)

## Description
The data grafana dashboard by default should work well when viewing
across all operators. Use a percentile graph that is grouped by operator
instead.

For the histogram bar charts, hide that in the operator panels row. This
is useful for areas where we by default filter by a single operator
(like in the data dashboard)

<img width="1163" height="379" alt="Screenshot 2025-11-14 at 2 33 16 PM"
src="https://github.com/user-attachments/assets/fd4a3d0c-4a60-4bb9-a803-859b3ed14a59"
/>
<img width="1158" height="430" alt="Screenshot 2025-11-14 at 2 33 08 PM"
src="https://github.com/user-attachments/assets/a78b4dde-8066-478b-86b4-b838761431f2"
/>

---------

Signed-off-by: Alan Guo <aguo@anyscale.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Ray Data-related issues docs An issue or change related to documentation go add ONLY when ready to merge, run all tests observability Issues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profiling

3 participants