Repository navigation
Support IP Adapter for AnimateDiffPipeline #5976
Description
Like title says, request is to support newly IP adapter (via PR #5713) for existing AnimateDiffPipeline
as AnimateDiff would greatly benefit from style stabilization brought by IP adapter
Activity
DN6 commentedon Nov 29, 2023
@yiyixuxu I believe you were already working on this right?
yiyixuxu commentedon Nov 29, 2023
yep yep @sayakpaul is here to prove
yiyixuxu commentedon Nov 29, 2023
face model will be supported soon I think will works better for animatediff
yiyixuxu commentedon Nov 29, 2023
@vladmandic
we haven't done any comms about it and I guess very easy to miss in our doc but here it is
https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters?model=AnimateDiff
vladmandic commentedon Nov 29, 2023
right :)
i used diffusers from main branch from two days ago and
AnimateDiffPipelinedid not haveload_ip_adaptermethod.just checked out latest diffusers main and it works fine! thanks!
sayakpaul commentedon Nov 30, 2023
Thanks for checking! If you have a cool example to share with us, that would be great!
vladmandic commentedon Dec 1, 2023
basic animatediff plus ip-adapter and with sdnext built-in rife interpolation to boost frame count from 16 to 120
00021-lyriel-v16-beautiful.wearing.a.tight.dress.in.a.city.mp4