Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does this apply to unet? #2

Open
songh11 opened this issue Nov 25, 2024 · 3 comments
Open

Does this apply to unet? #2

songh11 opened this issue Nov 25, 2024 · 3 comments

Comments

@songh11
Copy link

songh11 commented Nov 25, 2024

No description provided.

@ziyu-guo
Copy link
Contributor

ziyu-guo commented Dec 2, 2024

Hi there, thank you for your interest in this work. We're doing additional experiments to measure the effectiveness of this technique on UNet architecture. Will keep you posted.

@songh11
Copy link
Author

songh11 commented Dec 3, 2024

Hi there, thank you for your interest in this work. We're doing additional experiments to measure the effectiveness of this technique on UNet architecture. Will keep you posted.

Thanks for your reply❤️, I tried on sdxl and there are two problems(used threshold_0.08 json).

  1. The result within 20 steps is abnormal.
  2. It's gonna be different from the original on 50 steps.
    And could you tell me how to get smoothcache_schedule on other steps?

@kelpabc123
Copy link
Contributor

kelpabc123 commented Dec 3, 2024

Hi, the schedules only currently work on the DiT model, as while the technique works on multiple models, you need to run an initial calibration pass to generate the schedule for each architecture (as different checkpoints have different optimal caching schedules). To generate one that works for SDXL, you will need to regenerate the schedule specifically for that architecture. Stay tuned for sample code that will enable that. If you can't wait, you can also take a stab at generating the schedule yourself with SDXL based on what we described in our paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants