Baizhou Zhang 44eab2b27f [shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506) ...

* add APIs

* implement save_sharded_model

* add test for hybrid checkpointio

* implement naive loading for sharded model

* implement efficient sharded model loading

* open a new file for hybrid checkpoint_io

* small fix

* fix circular importing

* fix docstring

* arrange arguments and apis

* small fix

2023-08-25 22:04:57 +08:00

..

gemini

[shardformer] support sharded checkpoint IO for models of HybridParallelPlugin (#4506)

2023-08-25 22:04:57 +08:00

legacy

[nfc] fix typo colossalai/zero (#3923)

2023-06-08 00:01:29 +08:00

low_level

[hotfix] fix unsafe async comm in zero (#4404)

2023-08-11 15:09:24 +08:00

__init__.py

[zero] reorganize zero/gemini folder structure (#3424)

2023-04-04 13:48:16 +08:00

wrapper.py

[doc] Fix typo under colossalai and doc(#3618)

2023-04-26 11:38:43 +08:00