-
Notifications
You must be signed in to change notification settings - Fork 6.1k
Text2video zero refinements #3733
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Text2video zero refinements #3733
Conversation
…d99/diffusers into text2video-zero-refinements
…d99/diffusers into text2video-zero-refinements
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! Thank you.
Have you ensured that the existing tests pass with PT 2.0?
Co-authored-by: Sayak Paul <[email protected]>
|
The documentation is not available anymore as the PR was closed or merged. |
@19and99 we need to ensure the tests are passing here. Also you probably to add comments in #3733 (comment). |
Test failures are unrelated merging! |
* fix docs typos. add frame_ids argument to text2video-zero pipeline call * make style && make quality * add support of pytorch 2.0 scaled_dot_product_attention for CrossFrameAttnProcessor * add chunk-by-chunk processing to text2video-zero docs * make style && make quality * Update docs/source/en/api/pipelines/text_to_video_zero.mdx Co-authored-by: Sayak Paul <[email protected]> --------- Co-authored-by: Sayak Paul <[email protected]>
* fix docs typos. add frame_ids argument to text2video-zero pipeline call * make style && make quality * add support of pytorch 2.0 scaled_dot_product_attention for CrossFrameAttnProcessor * add chunk-by-chunk processing to text2video-zero docs * make style && make quality * Update docs/source/en/api/pipelines/text_to_video_zero.mdx Co-authored-by: Sayak Paul <[email protected]> --------- Co-authored-by: Sayak Paul <[email protected]>
CrossFrameAttnProcessor2_0
using Pytorch 2.0scaled_dot_product_attention
TextToVideoZeroPipeline
choosesCrossFrameAttnProcessor2_0
as attention processor when Pytorch 2.0 is availableframe_ids
parameter toTextToVideoZeroPipeline
call function to allow generating longer videos chunk-by-chunkCloses: #3434