github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-29 08:47:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #2338 from haofanwang/patch-1

Browse Source 
Fix a typo in train_dreambooth_colossalai.py
This commit is contained in:
Fazzie-Maqianli 2023-01-06 11:50:18 +08:00 committed by GitHub
commit 7a332b1734
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/images/dreambooth/train_dreambooth_colossalai.py
View File

@ -484,7 +484,7 @@ def main(args):
unet.enable_gradient_checkpointing()
if args.scale_lr:
args.learning_rate = args.learning_rate * args.gradient_accumulation_steps * args.train_batch_size * 2
args.learning_rate = args.learning_rate * args.gradient_accumulation_steps * args.train_batch_size * gpc.get_world_size(ParallelMode.DATA)
unet = gemini_zero_dpp(unet, pg, args.placement)