LCM Distill Scripts Fix Bug when Initializing Target U-Net #6848
Conversation
…correctly add time_embedding.cond_proj if necessary.
|
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Please note that issues that do not follow the contributing guidelines are likely to be ignored. |
|
@patil-suraj gentle ping. |
|
@patil-suraj could you give this a look? |
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. Please note that issues that do not follow the contributing guidelines are likely to be ignored. |
* Initialize target_unet from unet rather than teacher_unet so that we correctly add time_embedding.cond_proj if necessary. * Use UNet2DConditionModel.from_config to initialize target_unet from unet's config. --------- Co-authored-by: Sayak Paul <[email protected]>
4 participants
What does this PR do?
This PR initializes the
target_unettarget model config fromunetrather thanteacher_unetin the LCM full model distillation scripts. This ensures that if we add atime_embedding.cond_projtounetfor the guidance scale embedding (becauseteacher_unetdoes not have it),target_unetis also properly initialized with atime_embedding.cond_proj.Fixes #6790.
Before submitting
documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.
@patrickvonplaten
@sayakpaul
@patil-suraj
@shadowofsoul