github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-10 15:55:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,460 Commits 62 Branches 51 Tags
cea4292ae5ce7563f94bb7deef6f1b9bd155ecc5
Commit Graph

2 Commits

Author SHA1 Message Date
HELSON
63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) 
* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol
 2022-12-09 18:09:17 +08:00
Jiarui Fang
f7e276fa71 [Gemini] add GeminiAdamOptimizer (#1960) 2022-11-16 14:44:28 +08:00