Jiarui Fang 2f95df5934 [zero] able to place params on cpu after zero init context (#365) ...

* place params on cpu after zero init context

* polish code

2022-03-10 14:08:58 +08:00

..

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-08 18:18:06 +08:00

_base_ophook.py

add pytorch hooks (#179)

2022-01-25 22:20:54 +08:00

_memtracer_ophook.py

move async memory to an individual directory (#345)

2022-03-09 16:31:25 +08:00

_shard_grad_ophook.py

[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)

2022-03-02 18:28:29 +08:00

_shard_param_ophook.py

fix sharded param hook and unit test

2022-03-04 15:27:39 +08:00

zero_hook.py

[zero] able to place params on cpu after zero init context (#365)

2022-03-10 14:08:58 +08:00