Skip to content

[Bugfix] fix qwen3.5 ep weight loading#45002

Merged
ZJY0516 merged 5 commits into
vllm-project:mainfrom
ZJY0516:fix-qwen35-ep-weight-load
Jun 9, 2026
Merged

[Bugfix] fix qwen3.5 ep weight loading#45002
ZJY0516 merged 5 commits into
vllm-project:mainfrom
ZJY0516:fix-qwen35-ep-weight-load

Conversation

@ZJY0516

@ZJY0516 ZJY0516 commented Jun 9, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

Purpose

Fix https://buildkite.com/vllm/ci/builds/70731/list?jid=019eaaf8-d7a5-4813-9dc2-5b4f9b39f36f&tab=output

FusedMoE refactoring #41184 breaks it

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan, such as providing test command.
  • The test results, such as pasting the results comparison before and after, or e2e results
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
@ZJY0516
update
6787097 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@ZJY0516 ZJY0516 added the ready ONLY add when PR is ready to merge/full CI is needed label Jun 9, 2026
@mergify mergify Bot added qwen Related to Qwen models bug Something isn't working labels Jun 9, 2026
bnellnm
bnellnm reviewed Jun 9, 2026
View reviewed changes
Comment thread vllm/model_executor/models/qwen3_5.py Outdated
@ZJY0516
update
b135b20 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@ZJY0516 ZJY0516 enabled auto-merge (squash) June 9, 2026 15:57
@ZJY0516
update
ab25687 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@ZJY0516
update
fcad52c 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@bnellnm

bnellnm commented Jun 9, 2026

Copy link
Copy Markdown
Collaborator

FYI, I see the same code pattern in the loader in the following files:

vllm/model_executor/models/qwen3_5.py
vllm/model_executor/models/qwen3_5_mtp.py
vllm/model_executor/models/qwen3_vl_moe.py
vllm/model_executor/models/step3_text.py
vllm/model_executor/models/step3p5.py
vllm/model_executor/models/step3p5_mtp.py

They may all suffer from the same issue. I'm investigating the step models. I have not checked qwen3_vl_moe.py.
@bnellnm bnellnm mentioned this pull request Jun 9, 2026
Merged
4 tasks
@ZJY0516 ZJY0516 merged commit ca4cfd8 into vllm-project:main Jun 9, 2026
69 checks passed
@ZJY0516 ZJY0516 deleted the fix-qwen35-ep-weight-load branch June 10, 2026 01:19
waqahmed-amd-fi pushed a commit to waqahmed-amd-fi/vllm that referenced this pull request Jun 10, 2026
@ZJY0516 @waqahmed-amd-fi
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
e375018 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Waqar Ahmed <waqar.ahmed@amd.com>
Saddss pushed a commit to Saddss/vllm that referenced this pull request Jun 14, 2026
@ZJY0516
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
e970342 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
vivek8123 pushed a commit to odh-on-pz/vllm-upstream that referenced this pull request Jun 18, 2026
@ZJY0516
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
81e26b1 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@vadiklyutiy vadiklyutiy mentioned this pull request Jun 18, 2026
Open
1 task
divineearthly pushed a commit to divineearthly/vllm that referenced this pull request Jun 19, 2026
@ZJY0516 @divineearthly
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
ecbf107 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: divineearthly <divineearthly@gmail.com>
tunglinwood pushed a commit to tunglinwood/vllm that referenced this pull request Jun 22, 2026
@ZJY0516
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
4ed3c2f 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
@InfoSage05 InfoSage05 mentioned this pull request Jun 24, 2026
Open
nkzhenhua pushed a commit to nkzhenhua/vllm that referenced this pull request Jun 24, 2026
@ZJY0516 @nkzhenhua
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
326a468 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
ohsono pushed a commit to ohsono/vllm that referenced this pull request Jul 3, 2026
@ZJY0516
[Bugfix] fix qwen3.5 ep weight loading (vllm-project#45002)
ec477d9 
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working qwen Related to Qwen models ready ONLY add when PR is ready to merge/full CI is needed

3 participants

@ZJY0516 @bnellnm @jeejeelee