ver217 8dced41ad0 [zero] zero optim state_dict takes only_rank_0 (#1384) ...

* zero optim state_dict takes only_rank_0

* fix unit test

2022-07-29 13:22:50 +08:00

..

init_ctx

[hotfix] fix zero init ctx numel (#1128)

2022-06-16 17:17:27 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

[hotfix] shared model returns cpu state_dict (#1328)

2022-07-15 22:11:37 +08:00

sharded_optim

[checkpoint] sharded optim save/load grad scaler (#1350)

2022-07-21 15:21:21 +08:00

sharded_param

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

utils

[hotfix] remove potiential circle import (#1307)

2022-07-14 13:44:26 +08:00

__init__.py

[zero] add zero optimizer for ColoTensor (#1046)

2022-06-02 12:13:15 +08:00

zero_optimizer.py

[zero] zero optim state_dict takes only_rank_0 (#1384)

2022-07-29 13:22:50 +08:00