ver217 a241f61b34 [zero] Update initialize for ZeRO (#458) ...

* polish code

* shard strategy receive pg in shard() / gather()

* update zero engine

* polish code

2022-03-18 16:18:31 +08:00

..

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00

_base_ophook.py

add pytorch hooks (#179)

2022-01-25 22:20:54 +08:00

_memtracer_ophook.py

Flake8 code restyle

2022-03-11 15:50:28 +08:00

_shard_grad_ophook.py

[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)

2022-03-11 15:50:28 +08:00

_shard_param_ophook.py

fix sharded param hook and unit test

2022-03-11 15:50:28 +08:00

zero_hook.py

[zero] Update initialize for ZeRO (#458)

2022-03-18 16:18:31 +08:00