ver217 9e1daa63d2 [zero] sharded optim supports loading local state dict (#1170) ...

* sharded optim supports loading local state dict

* polish code

* add unit test

2022-06-24 18:05:16 +08:00

..

init_ctx

[hotfix] fix zero init ctx numel (#1128)

2022-06-16 17:17:27 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

[hotfix] prevent nested ZeRO (#1140)

2022-06-21 11:33:53 +08:00

sharded_optim

[zero] sharded optim supports loading local state dict (#1170)

2022-06-24 18:05:16 +08:00

sharded_param

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

utils

[zero] avoid zero hook spam by changing log to debug level (#1137)

2022-06-21 10:44:01 +08:00

__init__.py

[zero] add zero optimizer for ColoTensor (#1046)

2022-06-02 12:13:15 +08:00

zero_optimizer.py

[zero] zero optim supports loading local state dict (#1171)

2022-06-24 17:25:57 +08:00