Skip to content

feat: enable ZeRO-3 sharding for TextEncoder and EMA model#492

Open
wuxibin89 wants to merge 4 commits intoPKU-YuanGroup:mainfrom
wuxibin89:wuxibin/text_and_ema_zero3
Open

feat: enable ZeRO-3 sharding for TextEncoder and EMA model#492
wuxibin89 wants to merge 4 commits intoPKU-YuanGroup:mainfrom
wuxibin89:wuxibin/text_and_ema_zero3

Conversation

@wuxibin89
Copy link

For OpenSoraT2V_v1_3-2B/122 model

  • VAE: no sharding
  • DiT: ZeRO-2
  • EMA: ZeRO-3 with FP32
  • T5: ZeRO-3
10/22/2024 16:33:05 - INFO - __main__ - Load VAE model finish, memory_allocated: 0.27 GB
10/22/2024 16:33:34 - INFO - __main__ - Load diffusion model finish, memory_allocated: 6.08 GB
10/22/2024 16:33:35 - INFO - __main__ - Load EMA model finish, memory_allocated: 6.73 GB
10/22/2024 16:34:25 - INFO - __main__ - Load text encoder model 1 finish, memory_allocated: 7.39 GB

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant