Skip to content

[Doc] Add multi-image input example and update supported models #8181

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 11 commits into from
Sep 5, 2024
Merged

[Doc] Add multi-image input example and update supported models #8181

merged 11 commits into from
Sep 5, 2024

Conversation

DarkLight1337
Copy link
Member

@DarkLight1337 DarkLight1337 commented Sep 5, 2024 •
edited
Loading

This PR updates the VLM documentation with examples for multi-image input.

It also updates the list of supported multi-modal models to indicate whether embeddings and multi-input are supported for each modality.

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 5, 2024

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can do one of these:

  • Add ready label to the PR
  • Enable auto-merge.

🚀

ywang96
ywang96 approved these changes Sep 5, 2024
View reviewed changes
Copy link
Member

@ywang96 ywang96 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Left a comment

@DarkLight1337 DarkLight1337 enabled auto-merge (squash) September 5, 2024 07:22
@github-actions github-actions bot added the ready ONLY add when PR is ready to merge/full CI is needed label Sep 5, 2024
@DarkLight1337 DarkLight1337 enabled auto-merge (squash) September 5, 2024 08:46
@DarkLight1337 DarkLight1337 changed the title [Doc] Indicate more information about supported modalities [Doc] Add multi-image input example and update supported models Sep 5, 2024
@DarkLight1337 DarkLight1337 merged commit 288a938 into vllm-project:main Sep 5, 2024
69 checks passed
@DarkLight1337 DarkLight1337 deleted the mm-support-docs branch September 5, 2024 10:52
@ywang96 ywang96 mentioned this pull request Sep 11, 2024
Open
54 tasks
dtrifiro pushed a commit to opendatahub-io/vllm that referenced this pull request Sep 12, 2024
@DarkLight1337 @dtrifiro
[Doc] Indicate more information about supported modalities (vllm-proj…
d3b718f 
…ect#8181)
Alvant pushed a commit to compressa-ai/vllm that referenced this pull request Oct 26, 2024
@DarkLight1337 @Alvant
[Doc] Indicate more information about supported modalities (vllm-proj…
c979f15 
…ect#8181)

Signed-off-by: Alvant <[email protected]>
LeiWang1999 pushed a commit to LeiWang1999/vllm-bitblas that referenced this pull request Mar 26, 2025
@DarkLight1337 @LeiWang1999
[Doc] Indicate more information about supported modalities (vllm-proj…
17957da 
…ect#8181)

Signed-off-by: LeiWang1999 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ywang96 ywang96 ywang96 approved these changes

Assignees

No one assigned

Labels

ready ONLY add when PR is ready to merge/full CI is needed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@DarkLight1337 @ywang96