[llm][docs] Document multimodal pixel-budget gotchas and vLLM compatibility#63593
Merged
Conversation
![gemini-code-assist[bot]](https://cdn.statically.io/img/avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Code Review
This pull request updates the VLM video examples and documentation to incorporate mm_processor_kwargs and media_io_kwargs, providing better control over video processing and frame sampling. It also introduces a vLLM compatibility table across troubleshooting guides, removes obsolete C/C++ runtime dependency information, and updates community links. Review feedback suggests aligning the num_frames parameter with the longest_edge pixel budget in the example code to avoid performance degradation from unintended downscaling, and improving documentation clarity regarding how the pixel budget affects GPU memory.
ray-gardener
Bot
added
serve
jeffreywang88
commented
May 29, 2026
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
jeffreywang88
force-pushed
the
mm-data-llm-fix
branch
from
671c21d to
c00280b
Compare
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
sampan-s-nayak
pushed a commit
to sampan-s-nayak/ray
that referenced
this pull request
Jun 10, 2026
…bility (ray-project#63593) ## Description - **Refine Qwen3-VL VLM video example and documentation.** <img width="1293" height="408" alt="Screenshot 2026-05-21 at 8 44 05 PM" src="https://github.com/user-attachments/assets/62bba88f-1b2b-44f6-950c-4386c0fa26fe" /> - **Remove C++ incompatibility guide (only applicable for Ray 2.55).** - **Add a Ray ↔ vLLM compatibility table.** <img width="1300" height="460" alt="Screenshot 2026-05-21 at 8 44 35 PM" src="https://github.com/user-attachments/assets/d50c8d81-a44e-49e8-be2b-f3d5d4762b95" /> - **Update office hour link.** - **Fix a doc rendering bug** **Before** <img width="564" height="194" alt="Screenshot 2026-05-21 at 8 57 20 PM" src="https://github.com/user-attachments/assets/292f0b9d-86d6-4552-976f-851efa4ddb8a" /> **After** <img width="533" height="198" alt="Screenshot 2026-05-21 at 9 00 37 PM" src="https://github.com/user-attachments/assets/74243bf6-cda8-45c7-b504-ee8514a06ec4" /> - **Fix `vLLMEngineProcessorConfig` inaccurate docstring** ## Related issues N/A ## Additional information > Optional: Add implementation details, API changes, usage examples, screenshots, etc. --------- Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
limarkdcunha
pushed a commit
to limarkdcunha/ray
that referenced
this pull request
Jun 30, 2026
…bility (ray-project#63593) ## Description - **Refine Qwen3-VL VLM video example and documentation.** <img width="1293" height="408" alt="Screenshot 2026-05-21 at 8 44 05 PM" src="https://github.com/user-attachments/assets/62bba88f-1b2b-44f6-950c-4386c0fa26fe" /> - **Remove C++ incompatibility guide (only applicable for Ray 2.55).** - **Add a Ray ↔ vLLM compatibility table.** <img width="1300" height="460" alt="Screenshot 2026-05-21 at 8 44 35 PM" src="https://github.com/user-attachments/assets/d50c8d81-a44e-49e8-be2b-f3d5d4762b95" /> - **Update office hour link.** - **Fix a doc rendering bug** **Before** <img width="564" height="194" alt="Screenshot 2026-05-21 at 8 57 20 PM" src="https://github.com/user-attachments/assets/292f0b9d-86d6-4552-976f-851efa4ddb8a" /> **After** <img width="533" height="198" alt="Screenshot 2026-05-21 at 9 00 37 PM" src="https://github.com/user-attachments/assets/74243bf6-cda8-45c7-b504-ee8514a06ec4" /> - **Fix `vLLMEngineProcessorConfig` inaccurate docstring** ## Related issues N/A ## Additional information > Optional: Add implementation details, API changes, usage examples, screenshots, etc. --------- Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Update office hour link.
Fix a doc rendering bug
Before
After
vLLMEngineProcessorConfiginaccurate docstringRelated issues
N/A
Additional information