github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-28 01:53:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
fce9432f08
ColossalAI/colossalai/zero/sharded_model
History
ver217 fce9432f08 sync before creating empty grad
2022-03-16 14:24:09 +08:00
..
__init__.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
_zero3_utils.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
param_manager.py Feature/zero (#279) 2022-03-11 15:50:28 +08:00
reduce_scatter.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_grad.py [zero] add sharded grad and refactor grad hooks for ShardedModel (#287) 2022-03-11 15:50:28 +08:00
sharded_model_v2.py sync before creating empty grad 2022-03-16 14:24:09 +08:00
sharded_model.py [zero] Update sharded model v2 using sharded param v2 (#323) 2022-03-11 15:50:28 +08:00
utils.py [test] polish zero related unitest (#351) 2022-03-11 15:50:28 +08:00