github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-07 20:10:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

polish optimizer docstring (#619)

Browse Source
This commit is contained in:
ver217
2022-04-01 16:27:03 +08:00
committed by GitHub
parent 8432dc7080
commit e619a651fb
5 changed files with 65 additions and 82 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/nn/optimizer/fused_lamb.py
View File

@@ -10,7 +10,7 @@ class FusedLAMB(torch.optim.Optimizer):
"""Implements LAMB algorithm.
Currently GPU-only. Requires ColossalAI to be installed via
``pip install -v --no-cache-dir --global-option="--cuda_ext" ./``.
``pip install .``.
This version of fused LAMB implements 2 fusions.