Repository navigation

Add LoRA support for Cosmos Predict 2.5 and fix pipeline to match official Cosmos repo - #13664

Merged

yiyixuxu merged 19 commits into

huggingface:mainfrom

terarachang:cosmos_predict_2.5_lora_clean

May 8, 2026

Merged

Add LoRA support for Cosmos Predict 2.5 and fix pipeline to match official Cosmos repo#13664
yiyixuxu merged 19 commits into
huggingface:mainfrom
terarachang:cosmos_predict_2.5_lora_clean

Commits on Apr 30, 2026
- support lora for cosmos 2.5
  Ting-Yun Chang
  committed
  48fbe84
- Fix inconsistencies with cosmos official repo in VAE encoding, text encoder attention implementation, and timestep scaling
  Ting-Yun Chang
  committed
  5216816
- Support f_min and f_max in linear_scheduler warmup
  Ting-Yun Chang
  committed
  3d5551b
- Add requirements and dataset preprocessing scripts to run examples
  Ting-Yun Chang
  committed
  f0b51ed
- Add LoRA training scripts
  Ting-Yun Chang
  committed
  9038e10
- Add LoRA eval scripts
  Ting-Yun Chang
  committed
  cee46cc
- add assets for blogpost
  Ting-Yun Chang
  committed
  9e24319
- Fix(scheduler): device mismatch from upstream b114620 - move rk and b to device before torch.stack
  Ting-Yun Chang
  committed
  c3bb1aa
- Always upcast to fp32
  Ting-Yun Chang
  committed
  d32b085
Commits on May 2, 2026
- Directly inhrit from LoraBaseMixin
  Ting-Yun Chang
  committed
  80aa547
Commits on May 5, 2026
- remove flash-attn2
  
  Ting-Yun Chang
  authored and
  terarachang
  committed
  c8513c2
- Use _keep_in_fp32_modules instead of autocast
  Ting-Yun Chang
  committed
  49f5b35
- remove the get_latent_shape_cthw method and fix style
  Ting-Yun Chang
  committed
  6acdc1c
- simplifiy the eval script to make it more user-friendly
  Ting-Yun Chang
  committed
  d4b27f6
- overwrite scheduling_unipc_multistep.py with main's version
  Ting-Yun Chang
  committed
  3cc1210
Commits on May 7, 2026
- remove network_alphas and add # Copied from
  Ting-Yun Chang
  committed
  38844fb
- remove figures and assets
  Ting-Yun Chang
  committed
  119822f
- revert scheduler
  Ting-Yun Chang
  committed
  770abee
- revert fp32 upcast and support bs > 1
  Ting-Yun Chang
  committed
  13cfbb0

Commits

Commits on Apr 30, 2026

Commits on May 2, 2026

Commits on May 5, 2026

Commits on May 7, 2026