Skip to content

[llm] Upgrade to vLLM 0.22.0#63730

Merged
elliot-barn merged 2 commits into
masterfrom
vllm-0.22.0
May 29, 2026
Merged

[llm] Upgrade to vLLM 0.22.0#63730
elliot-barn merged 2 commits into
masterfrom
vllm-0.22.0

Conversation

@jeffreywang88

@jeffreywang88 jeffreywang88 commented May 29, 2026

Copy link
Copy Markdown
Contributor

Description

Upgrade to vLLM 0.22.0 and fix breaking vLLM APIs.

Related issues

Link related issues: "Fixes #1234", "Closes #1234", or "Related to #1234".

Additional information

Optional: Add implementation details, API changes, usage examples, screenshots, etc.

@jeffreywang88 jeffreywang88 added the go add ONLY when ready to merge, run all tests label May 29, 2026
@jeffreywang88 jeffreywang88 changed the title Upgrade to vLLM 0.20.0 May 29, 2026

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request upgrades the vLLM dependency from version 0.21.0 to 0.22.0 across the Dockerfile, requirements, setup, and lock files, alongside updating dependent packages like flashinfer and llguidance. It also adapts the codebase to vLLM's new speech-to-text import paths. Feedback suggests updating the pull request title to accurately reflect the upgrade to version 0.22.0 instead of 0.20.0.

Comment thread python/requirements/llm/llm-requirements.txt
@jeffreywang88 jeffreywang88 changed the title [llm] Upgrade to vLLM 0.20.0 May 29, 2026
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
@jeffreywang88

Copy link
Copy Markdown
Contributor Author

What a smooth upgrade :)

@eicherseiji eicherseiji left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we love to see it

@jeffreywang88 jeffreywang88 marked this pull request as ready for review May 29, 2026 22:49
@jeffreywang88 jeffreywang88 requested review from a team, edoakes and richardliaw as code owners May 29, 2026 22:49
@elliot-barn elliot-barn merged commit 77bae97 into master May 29, 2026
6 checks passed
@elliot-barn elliot-barn deleted the vllm-0.22.0 branch May 29, 2026 22:50
rueian pushed a commit to rueian/ray that referenced this pull request Jun 4, 2026
## Description
Upgrade to vLLM 0.22.0 and fix breaking vLLM APIs.

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
limarkdcunha pushed a commit to limarkdcunha/ray that referenced this pull request Jun 30, 2026
## Description
Upgrade to vLLM 0.22.0 and fix breaking vLLM APIs.

## Related issues
> Link related issues: "Fixes ray-project#1234", "Closes ray-project#1234", or "Related to
ray-project#1234".

## Additional information
> Optional: Add implementation details, API changes, usage examples,
screenshots, etc.

---------

Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

go add ONLY when ready to merge, run all tests

3 participants