github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-30 17:22:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: typo in comment of low_level_zero plugin

Browse Source
This commit is contained in:
shaoyuw 2023-10-05 16:30:34 +00:00
parent d1fcc0fa4d
commit c97a3523db
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/booster/plugin/low_level_zero_plugin.py
View File

@ -226,7 +226,7 @@ class LowLevelZeroPlugin(DPPluginBase):
``` ```
Args: Args:
strage (int, optional): ZeRO stage. Defaults to 1. stage (int, optional): ZeRO stage. Defaults to 1.
precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'. precision (str, optional): precision. Support 'fp16', 'bf16' and 'fp32'. Defaults to 'fp16'.
initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32. initial_scale (float, optional): Initial scale used by DynamicGradScaler. Defaults to 2**32.
min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1. min_scale (float, optional): Min scale used by DynamicGradScaler. Defaults to 1.