Repository navigation

[Training] Add `datasets` version of LCM LoRA SDXL - #5778

Merged

sayakpaul merged 109 commits into

mainfrom

lcm-lora-sdxl-datasets

Dec 26, 2023

Merged

[Training] Add `datasets` version of LCM LoRA SDXL#5778
sayakpaul merged 109 commits into
mainfrom
lcm-lora-sdxl-datasets

Commits on Nov 13, 2023
- add: script to train lcm lora for sdxl with 🤗 datasets
  sayakpaul
  committed
  ca7f220
- suit up the args.
  sayakpaul
  committed
  88efd15
- remove comments.
  sayakpaul
  committed
  9e49fd2
- fix num_update_steps
  sayakpaul
  committed
  728aa8a
- fix batch unmarshalling
  sayakpaul
  committed
  bc8cfdd
- fix num_update_steps_per_epoch
  sayakpaul
  committed
  8c4d4b6
- fix; dataloading.
  sayakpaul
  committed
  6d2f740
- fix microconditions.
  sayakpaul
  committed
  c7f2828
- unconditional predictions debug
  sayakpaul
  committed
  df70754
- fix batch size.
  sayakpaul
  committed
  dd93227
- no need to use use_auth_token
  sayakpaul
  committed
  3d4b1da
- Apply suggestions from code review
  
  sayakpaul
  and
  patil-suraj
  authored
  7967247
- make vae encoding batch size an arg
  sayakpaul
  committed
  6b2e42f
- final serialization in kohya
  sayakpaul
  committed
  d7f632e
- style
  sayakpaul
  committed
  e4edb31
Commits on Nov 14, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  858009b
- state dict rejigging
  sayakpaul
  committed
  6aa2dd8
- feat: no separate teacher unet.
  sayakpaul
  committed
  1fd3378
- debug
  sayakpaul
  committed
  4135414
- fix state dict serialization
  sayakpaul
  committed
  3b066d2
- debug
  sayakpaul
  committed
  fc5546f
- debug
  sayakpaul
  committed
  ba0d0f2
- debug
  sayakpaul
  committed
  35e30fb
- remove prints.
  sayakpaul
  committed
  53c13f7
- remove kohya utility and make style
  sayakpaul
  committed
  cff23ed
- fix serialization
  sayakpaul
  committed
  ca076c7
- fix
  sayakpaul
  committed
  808f61e
- add test
  sayakpaul
  committed
  842df25
- add peft dependency.
  sayakpaul
  committed
  0027673
- add: peft
  sayakpaul
  committed
  c625553
- remove peft
  sayakpaul
  committed
  c5317ff
- autocast device determination from accelerator
  sayakpaul
  committed
  6a690ab
- autocast
  sayakpaul
  committed
  8c4eaf6
- reduce lora rank.
  sayakpaul
  committed
  cece781
- remove unneeded space
  sayakpaul
  committed
  beb8aa2
- Apply suggestions from code review
  
  sayakpaul
  and
  patil-suraj
  authored
  33cb9d0
- style
  sayakpaul
  committed
  795cc9f
- remove prompt dropout.
  sayakpaul
  committed
  042f357
- also save in native diffusers ckpt format.
  sayakpaul
  committed
  283af65
- debug
  sayakpaul
  committed
  5e099a2
- debug
  sayakpaul
  committed
  71db43a
- debug
  sayakpaul
  committed
  e1346d5
- better formation of the null embeddings.
  sayakpaul
  committed
  dfcf234
- remove space.
  sayakpaul
  committed
  5ce6cc1
- autocast fixes.
  sayakpaul
  committed
  7ee9d5d
- autocast fix.
  sayakpaul
  committed
  1b359ae
- hacky
  sayakpaul
  committed
  82b628a
Commits on Nov 16, 2023
- remove lora_sayak
  sayakpaul
  committed
  17d5c0d
- Apply suggestions from code review
  
  sayakpaul
  and
  younesbelkada
  authored
  fea95e0
- style
  sayakpaul
  committed
  83801a6
- make log validation leaner.
  sayakpaul
  committed
  0c5d934
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  committed
  3b034be
- move back enabled in.
  sayakpaul
  committed
  0f42185
- fix: log_validation call.
  sayakpaul
  committed
  41f1925
- add: checkpointing tests
  sayakpaul
  committed
  bf5c5d6
Commits on Nov 17, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  64063c7
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  committed
  53cf0e7
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  de958dc
Commits on Nov 27, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  5824fa3
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  committed
  f52cb6e
- taking my chances to see if disabling autocasting has any effect?
  sayakpaul
  committed
  5534b0c
Commits on Nov 30, 2023
- resolve conflicts
  sayakpaul
  committed
  3bacd82
- start debugging
  sayakpaul
  committed
  1da3071
- name
  sayakpaul
  committed
  bd4d1c4
- name
  sayakpaul
  committed
  26f16c1
- name
  sayakpaul
  committed
  9174027
- more debug
  sayakpaul
  committed
  92ba868
- more debug
  sayakpaul
  committed
  1fba251
- index
  sayakpaul
  committed
  3751ca9
- remove index.
  sayakpaul
  committed
  63649d3
- print length
  sayakpaul
  committed
  05de542
- print length
  sayakpaul
  committed
  5e604a8
- print length
  sayakpaul
  committed
  8fecdda
Commits on Dec 1, 2023
- move unet.train() after add_adapter()
  sayakpaul
  committed
  023866f
- disable some prints.
  sayakpaul
  committed
  07c28de
- enable_adapters() manually.
  sayakpaul
  committed
  c6a61da
Commits on Dec 2, 2023
- remove prints.
  sayakpaul
  committed
  ec33085
Commits on Dec 3, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  committed
  d14dd41
- some changes.
  sayakpaul
  committed
  ed7969d
- fix params_to_optimize
  sayakpaul
  committed
  8c549e4
- more fixes
  sayakpaul
  committed
  9446066
- debug
  sayakpaul
  committed
  0153665
- debug
  sayakpaul
  committed
  b9891ff
- remove print
  sayakpaul
  committed
  b11b0a6
- disable grad for certain contexts.
  sayakpaul
  committed
  539bda3
Commits on Dec 7, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  patil-suraj
  authored
  dfe916d
Commits on Dec 11, 2023
- Add support for IPAdapterFull (#5911)
  
  authored and
  sayakpaul
  committed
  d5a40cd
- Fix a bug in `add_noise` function (#6085)
  
  authored and
  sayakpaul
  committed
  e3d76c4
- [Advanced Diffusion Script] Add Widget default text (#6100)
  
  apolinario
  authored and
  sayakpaul
  committed
  472c397
- [Advanced Training Script] Fix pipe example (#6106)
  
  apolinario
  authored and
  sayakpaul
  committed
  373d392
- IP-Adapter for StableDiffusionControlNetImg2ImgPipeline (#5901)
  
  charchit7
  and
  sayakpaul
  committed
  be46b6e
- IP adapter support for most pipelines (#5900)
  
  committed
  c7a87ca
Commits on Dec 15, 2023
- resolve conflicts
  sayakpaul
  committed
  556b797
Commits on Dec 20, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  a8d9785
- fix: lora_alpha
  sayakpaul
  committed
  47abcf6
- make vae casting conditional/
  sayakpaul
  committed
  b7c0f95
- param upcasting
  sayakpaul
  committed
  7a1d6c9
- propagate comments from https://github.com/huggingface/diffusers/pull/6145
  
  sayakpaul
  and
  dg845
  committed
  87f87a7
Commits on Dec 26, 2023
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  404351f
- [Peft] fix saving / loading when unet is not "unet" (#6046)
  
  kashif
  and
  sayakpaul
  committed
  4c7e983
- [Wuerstchen] fix fp16 training and correct lora args (#6245)
  
  kashif
  and
  sayakpaul
  committed
  0bb9cf0
- [docs] fix: animatediff docs (#6339)
  sayakpaul
  committed
  11659a6
- add: note about the new script in readme_sdxl.
  sayakpaul
  committed
  f645b87
- Revert "[Peft] fix saving / loading when unet is not "unet" (#6046)"
  sayakpaul
  committed
  fd64acf
- Revert "[Wuerstchen] fix fp16 training and correct lora args (#6245)"
  sayakpaul
  committed
  121567b
- Revert "[docs] fix: animatediff docs (#6339)"
  sayakpaul
  committed
  c24626a
- remove tokenize_prompt().
  sayakpaul
  committed
  4c689b2
- assistive comments around enable_adapters() and diable_adapters().
  sayakpaul
  committed
  1b49fb9
- Merge branch 'main' into lcm-lora-sdxl-datasets
  sayakpaul
  authored
  9b3dbaa

Commits

Commits on Nov 13, 2023

Commits on Nov 14, 2023

Commits on Nov 16, 2023

Commits on Nov 17, 2023

Commits on Nov 27, 2023

Commits on Nov 30, 2023

Commits on Dec 1, 2023

Commits on Dec 2, 2023

Commits on Dec 3, 2023

Commits on Dec 7, 2023

Commits on Dec 11, 2023

Commits on Dec 15, 2023

Commits on Dec 20, 2023

Commits on Dec 26, 2023