Repository navigation
Magcache Support. #12697
Description
Activity
Hi!
We have a MagCache version in our main repo.@sayakpaul hiw can we integrate MagCache into Diffusers pipeline?
We support a bunch of caching techniques in Diffusers:
https://huggingface.co/docs/diffusers/main/en/api/cacheI think we could ship MagCache in a similar manner. Good reference would be FirstBlock cache:
https://huggingface.co/docs/diffusers/main/en/api/cache#diffusers.FirstBlockCacheConfigThis issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
Id like to see magcache acceleration supported if possible. My own testing shows it to cut video generation times in half with almost no quality loss at all. It seems to be considerably better quality than something like teacache or more efficient attention mechanisms.
https://github.com/Zehong-Ma/MagCache
Kandinsky5 I2V Normal inference: 1168 seconds
The_chili_pepper_monster_explo.mp4
Kandinsky5 I2V Magcache Inference: 592 seconds
The_chili_pepper_monster_explo_copy.mp4
@leffff
@Zehong-Ma