github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-25 18:13:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
493 Commits 59 Branches 51 Tags
595bedf7678d1d157e7a8e8230e266ddf21a26d3
Commit Graph

2 Commits

Author SHA1 Message Date
HELSON
055fbf5be6 [zero] adapt zero for unsharded paramters (Optimizer part) (#601) 2022-04-01 20:10:47 +08:00
HELSON
a30e2b4c24 [zero] adapt for no-leaf module in zero (#535) 
only process module's own parameters in Zero context

add zero hooks for all modules that contrain parameters

gather parameters only belonging to module itself
 2022-03-28 17:42:18 +08:00