Skip to content

Revert "[data] continue grabbing task state until response is not Non…e (#60592)" - #61064

Merged
aslonnie merged 1 commit into
masterfrom
ak/hng-dtr-rev
Feb 14, 2026
Merged

aslonnie merged 1 commit into
masterfrom
ak/hng-dtr-rev

Conversation

@alexeykudinkin

@alexeykudinkin alexeykudinkin commented Feb 14, 2026 •

Copy link
Copy Markdown
Contributor

This reverts commit 685d6d9.

This is causing a sever regression by repeatedly hitting ray.util.state.get_task without any backoff on failures.

Screenshot 2026-02-13 at 10 42 24 PM

Description

Briefly describe what this PR accomplishes and why it's needed.

Related issues

Link related issues: "Fixes #1234", "Closes #1234", or "Related to #1234".

Additional information

Optional: Add implementation details, API changes, usage examples, screenshots, etc.

#60592)"

This reverts commit 685d6d9.

Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
@alexeykudinkin
alexeykudinkin requested a review from a team as a code owner February 14, 2026 06:36

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request reverts a previous commit that introduced a performance regression in the hanging task detector. The regression was caused by repeatedly calling ray.util.state.get_task for hanging tasks on every detection cycle.

The changes correctly fix this issue by moving the call to ray.util.state.get_task to be conditional, only executing when a task is first identified as potentially hanging or when its output status changes. This significantly reduces the number of API calls. The associated helper function get_latest_state_for_task has been removed, and the test has been updated to match the modified log message format.

The changes look good and effectively address the regression. I have no further comments.

@alexeykudinkin
alexeykudinkin enabled auto-merge (squash) February 14, 2026 06:51
@github-actions github-actions Bot added the go add ONLY when ready to merge, run all tests label Feb 14, 2026
aslonnie added a commit to anyscale/ray that referenced this pull request Feb 14, 2026
@aslonnie
aslonnie disabled auto-merge February 14, 2026 09:17
@aslonnie
aslonnie merged commit feca476 into master Feb 14, 2026
7 checks passed
@aslonnie
aslonnie deleted the ak/hng-dtr-rev branch February 14, 2026 09:17
aslonnie added a commit that referenced this pull request Feb 14, 2026
…e" (#61066)

revert #60592, cherrypick #61064

Signed-off-by: Lonnie Liu <lonnie@anyscale.com>
ans9868 pushed a commit to ans9868/ray that referenced this pull request Feb 18, 2026
……e (ray-project#60592)" (ray-project#61064)

This reverts commit 685d6d9.

This is causing a sever regression by repeatedly hitting
`ray.util.state.get_task` without any backoff on failures.

<img width="1920" height="880" alt="Screenshot 2026-02-13 at 10 42
24 PM"
src="https://github.com/user-attachments/assets/2a99ea4a-5e88-434d-aa4d-9a51a91ca832"
/>

## Description
> Briefly describe what this PR accomplishes and why it's needed.

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
Signed-off-by: Adel Nour <ans9868@nyu.edu>
Aydin-ab pushed a commit to kunling-anyscale/ray that referenced this pull request Feb 20, 2026
……e (ray-project#60592)" (ray-project#61064)

This reverts commit 685d6d9.

This is causing a sever regression by repeatedly hitting
`ray.util.state.get_task` without any backoff on failures.

<img width="1920" height="880" alt="Screenshot 2026-02-13 at 10 42
24 PM"
src="https://github.com/user-attachments/assets/2a99ea4a-5e88-434d-aa4d-9a51a91ca832"
/>


## Description
> Briefly describe what this PR accomplishes and why it's needed.

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

Signed-off-by: Alexey Kudinkin <ak@anyscale.com>
iamjustinhsu added a commit to iamjustinhsu/ray that referenced this pull request Mar 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests

3 participants