Skip to content

Conversation

@sayakpaul
Copy link
Member

@sayakpaul sayakpaul commented Sep 10, 2023

This PR adds:

  • a test ensuring pipelines with components containing fused LoRA modules can be serialized correctly.
  • documentation

This has been quite a requested feature from the community I think.

@DN6 okay for you if we added this test?

Copy link
Contributor

@patrickvonplaten patrickvonplaten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool!

@DN6
Copy link
Collaborator

DN6 commented Sep 11, 2023

@sayakpaul If you don't mind just adding the total time taken to run these LoRA tests here as a comment? Just to have an idea of the additional overhead being introduced to the runners? The pytest summary report is fine.

Copy link
Member

@stevhliu stevhliu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! 👍

@sayakpaul
Copy link
Member Author

@sayakpaul If you don't mind just adding the total time taken to run these LoRA tests here as a comment? Just to have an idea of the additional overhead being introduced to the runners? The pytest summary report is fine.

@DN6 find it below.

logs_58445.zip

@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Sep 13, 2023

The documentation is not available anymore as the PR was closed or merged.

@sayakpaul
Copy link
Member Author

I thought #4971 fixed the FLAX problem. @patrickvonplaten?

@patrickvonplaten
Copy link
Contributor

Only failing test seems to be the flaky one. Let's merge this

@sayakpaul sayakpaul merged commit 8009272 into main Sep 13, 2023
@patrickvonplaten patrickvonplaten deleted the serialize_fuse_lora_params_docs branch September 13, 2023 09:07
AmericanPresidentJimmyCarter pushed a commit to AmericanPresidentJimmyCarter/diffusers that referenced this pull request Apr 26, 2024
…containing fused LoRA modules (huggingface#4962)

* add: test to ensure pipelines can be saved with fused lora modules.

* add docs about serialization with fused lora.

* Apply suggestions from code review

Co-authored-by: Steven Liu <[email protected]>

* Empty-Commit

* Update docs/source/en/training/lora.md

Co-authored-by: Patrick von Platen <[email protected]>

---------

Co-authored-by: Steven Liu <[email protected]>
Co-authored-by: Patrick von Platen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants