Skip to content

[LoRA] don't break offloading for incompatible lora ckpts. #5085

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Sep 18, 2023

Conversation

sayakpaul
Copy link
Member

@sayakpaul sayakpaul commented Sep 18, 2023

Addresses: #5060 (comment).

This PR will also follow another refactoring PR (potentially if needed after the peft integration) taking inspiration from #5076.

@patrickvonplaten
Copy link
Contributor

Wait one sec, double-checking if this works. Think there might still be an error

@patrickvonplaten patrickvonplaten self-requested a review September 18, 2023 14:29
Copy link
Contributor

@patrickvonplaten patrickvonplaten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This still doesn't solve examples where an incorrect LoRA version is loaded. E.g. this: #5060 (comment)

still fails. Think we need to go a bit deeper here

@patrickvonplaten patrickvonplaten changed the title don't break offloading for incompatible lora ckpts. [LoRA] don't break offloading for incompatible lora ckpts. Sep 18, 2023
@sayakpaul
Copy link
Member Author

Feel free to merge it. Like how it turned out!

@patrickvonplaten patrickvonplaten merged commit ed50768 into main Sep 18, 2023
@patrickvonplaten patrickvonplaten deleted the fix/lora-offloadingh branch September 18, 2023 21:59
patrickvonplaten added a commit that referenced this pull request Sep 18, 2023
* don't break offloading for incompatible lora ckpts.

* debugging

* better condition.

* fix

* fix

* fix

* fix

---------

Co-authored-by: Patrick von Platen <[email protected]>
yoonseokjin pushed a commit to yoonseokjin/diffusers that referenced this pull request Dec 25, 2023
…ce#5085)

* don't break offloading for incompatible lora ckpts.

* debugging

* better condition.

* fix

* fix

* fix

* fix

---------

Co-authored-by: Patrick von Platen <[email protected]>
AmericanPresidentJimmyCarter pushed a commit to AmericanPresidentJimmyCarter/diffusers that referenced this pull request Apr 26, 2024
…ce#5085)

* don't break offloading for incompatible lora ckpts.

* debugging

* better condition.

* fix

* fix

* fix

* fix

---------

Co-authored-by: Patrick von Platen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants