Skip to content

Commit cb03fee

Browse files
authored
[Bugfix][Ray] Fix RayExecutorV2 actor name collision with DP > 1 (#40398)
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
1 parent c51df43 commit cb03fee

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

‎vllm/v1/engine/utils.py‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -403,6 +403,11 @@ def __init__(
403403
range(dp_size), local_dp_ranks, placement_groups
404404
):
405405
dp_vllm_config = copy.deepcopy(vllm_config)
406+
if dp_size > 1:
407+
# Append the DP rank to instance_id so that per-engine
408+
# identifiers (e.g. Ray actor names in RayExecutorV2) are
409+
# unique across DP replicas.
410+
dp_vllm_config.instance_id = f"{dp_vllm_config.instance_id}_dp{index}"
406411
dp_vllm_config.parallel_config.placement_group = pg
407412
local_client = index < local_engine_count
408413

0 commit comments

Comments
 (0)