github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-02-22 06:52:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6ad866b68467c3f144aa2df7e019accfbefcf42d
ColossalAI/colossalai/zero/sharded_optim
History
HELSON a1ce02d740 [zero] test gradient accumulation (#1964) 
* [zero] fix memory leak for zero2

* [zero] test gradient accumulation

* [zero] remove grad clip test
2022-11-29 13:00:30 +08:00
..
bookkeeping
[zero] migrate zero1&2 (#1878)
2022-11-11 09:26:40 +08:00
__init__.py
[zero] migrate zero1&2 (#1878)
2022-11-11 09:26:40 +08:00
_utils.py
[zero] test gradient accumulation (#1964)
2022-11-29 13:00:30 +08:00
low_level_optim.py
[zero] test gradient accumulation (#1964)
2022-11-29 13:00:30 +08:00
sharded_optim_v2.py
fix move fp32 shards (#1604)
2022-09-16 17:33:16 +08:00