github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-11 08:13:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,863 Commits 59 Branches 51 Tags
077a5cdde409cc89b726240b4788717fba1e62c4
Commit Graph

2 Commits

Author SHA1 Message Date
HELSON
077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) 
* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing
 2023-01-29 15:09:57 +08:00
HELSON
21c88220ce [zero] add unit test for low-level zero init (#2474) 2023-01-15 10:42:01 +08:00