[Neuron] Add multi-LoRA support for Neuron.

[aws-satyajith]

Add multi-LoRA support for Neuron.

• Add a test using single and multiple LoRAs

RFC: #15970

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @aws-satyajith.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @aws-satyajith.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[liangfu]

thanks for contributing @aws-satyajith . the changes look good to me. it would be better if we could support dynamic lora loading, so that we don't need to pass lora-module in the argument.

[mrinalks]

@WoosukKwon @simon-mo could we get a quick review on this PR so we merge before V0 Freeze in 0.9.0? 🙏

[mergify]

This pull request has merge conflicts that must be resolved before it can be
merged. Please rebase the PR, @aws-satyajith.

https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/working-with-forks/syncing-a-fork

[jeejeelee]

Can we use override_neuron_config to include lora modules, instead of adding an additional argument lora_modules?

[aws-satyajith]

Makes sense. Since the regular usage diverges from dynamic loading anyway, I think moving lora_modules to override neuron config is doable. I'll make the change and publish a new revision

[jeejeelee]

Considering that most of the changes in this PR are within Neuron, after addressing the comments above, overall LGTM.

[mrinalks]

@jeejeelee @simon-mo seems like all checks are complete - we know that entrypoints has been flaky recently.
Ready to merge?

[GhostCCCatHenry]

这是来自QQ邮箱的假期自动回复邮件。   您好，我最近正在休假中，无法亲自回复您的邮件。我将在假期结束后，尽快给您回复。