LuGY 45b08f08cb [zero] optimize the optimizer step time (#4221) ...

* optimize the optimizer step time

* fix corner case

* polish

* replace all-reduce with all-gather

* set comm device to cuda

2023-07-31 22:13:29 +08:00

..

gemini

[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)

2023-07-21 14:39:01 +08:00

legacy

[nfc] fix typo colossalai/zero (#3923)

2023-06-08 00:01:29 +08:00

low_level

[zero] optimize the optimizer step time (#4221)

2023-07-31 22:13:29 +08:00

__init__.py

[zero] reorganize zero/gemini folder structure (#3424)

2023-04-04 13:48:16 +08:00

wrapper.py

[doc] Fix typo under colossalai and doc(#3618)

2023-04-26 11:38:43 +08:00