Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
3a3a250
Implement RayExecutorV2 & tested on a single-node
jeffreywang88 Mar 10, 2026
df75664
Enable multinode
jeffreywang88 Mar 12, 2026
bbaa21b
Fix pre-commit
jeffreywang88 Mar 16, 2026
2541f2d
Fix RayExecutorV2 monitor thread self-join
jeffreywang88 Mar 16, 2026
c3ad8e5
Remove unnecessary changes
Mar 17, 2026
300d0ae
Extract bundle sorting to a utility
jeffreywang88 Mar 17, 2026
11d32eb
Fix linter
jeffreywang88 Mar 17, 2026
5795f1d
Enable async scheduling
jeffreywang88 Mar 18, 2026
7128074
Address CR feedback
jeffreywang88 Mar 19, 2026
e7a3c1f
Address test feedback
jeffreywang88 Mar 19, 2026
5b4119a
Merge branch 'main' into ray
jeffreywang88 Mar 19, 2026
ec2730d
Iterate over world_size
jeffreywang88 Mar 19, 2026
ca95900
Fix tests and linters
jeffreywang88 Mar 19, 2026
139c02a
Respect VLLM_RAY_BUNDLE_INDICES
jeffreywang88 Mar 22, 2026
7657031
Adjust DP rank for ray executor backend
jeffreywang88 Mar 23, 2026
6c1ea7e
Apply DP local-rank device offset for RayExecutorV2 workers
jeffreywang88 Mar 23, 2026
d040317
Support DP
jeffreywang88 Mar 24, 2026
a76acc9
Fix linter
jeffreywang88 Mar 24, 2026
c9f0a39
Lazily initialize RayWorkerProc
jeffreywang88 Mar 25, 2026
29c7426
Propagate env var; add tests
jeffreywang88 Mar 25, 2026
aae5938
Add nsight profiling and non-GPU device support to RayExecutorV2
jeffreywang88 Mar 25, 2026
25eaf8e
Fix AsyncLLMActor async detection in e2e tests
jeffreywang88 Mar 26, 2026
6717ca2
Fix AsyncLLMActor async detection in e2e tests
jeffreywang88 Mar 26, 2026
cfba15e
Fix test
jeffreywang88 Mar 26, 2026
476501b
Fix test
jeffreywang88 Mar 26, 2026
c7aa661
Fix wrong PYTHONPATH in Ray workers
jeffreywang88 Mar 26, 2026
e0fd321
CR feedback round 1
jeffreywang88 Mar 30, 2026
af21cdd
CR feedback round 2
jeffreywang88 Mar 30, 2026
ad8f6d0
Only apply blacklist & propagate env with setdefault
jeffreywang88 Mar 30, 2026
605a347
Merge branch 'main' into ray
jeffreywang88 Mar 31, 2026
7586204
CR feedback round 3
jeffreywang88 Mar 31, 2026
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Enable async scheduling
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
  • Loading branch information
jeffreywang88 committed Mar 18, 2026
commit 5795f1d4d19d91b0e36ecf05dc8af215fb612778
2 changes: 1 addition & 1 deletion vllm/config/vllm.py
Original file line number Diff line number Diff line change
Expand Up @@ -687,7 +687,7 @@ def __post_init__(self):
"mp",
"uni",
"external_launcher",
)
) or (executor_backend == "ray" and envs.VLLM_USE_RAY_V2_EXECUTOR_BACKEND)

if self.scheduler_config.async_scheduling:
# Async scheduling explicitly enabled, hard fail any incompatibilities.
Expand Down
Loading