github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-11-30 15:55:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
63fbba3c19b5fe98a3f166eca9e78c52f509f1b5
ColossalAI/colossalai/nn/parallel/data_parallel.py
HELSON 63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) 
* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol
2022-12-09 18:09:17 +08:00

25 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink