github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-14 20:16:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
03654c0ce2de82c86367d16f594f692f0655108f
ColossalAI/colossalai/zero
History
LuGY 45b08f08cb [zero] optimize the optimizer step time (#4221) 
* optimize the optimizer step time

* fix corner case

* polish

* replace all-reduce with all-gather

* set comm device to cuda
2023-07-31 22:13:29 +08:00
..
gemini
[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)
2023-07-21 14:39:01 +08:00
legacy
…
low_level
[zero] optimize the optimizer step time (#4221)
2023-07-31 22:13:29 +08:00
__init__.py
…
wrapper.py
…