ver217 014bac0c49 [zero] hijack p.grad in sharded model (#554) ...

* hijack p.grad in sharded model

* polish comments

* polish comments

2022-03-30 18:14:50 +08:00

..

init_ctx

[zero] add zero context manager to change config during initialization (#546)

2022-03-29 17:57:59 +08:00

shard_utils

[zero] non model data tracing (#545)

2022-03-29 15:45:48 +08:00

sharded_model

[zero] hijack p.grad in sharded model (#554)

2022-03-30 18:14:50 +08:00

sharded_optim

[zero] hijack p.grad in sharded model (#554)

2022-03-30 18:14:50 +08:00

sharded_param

[zero] hijack p.grad in sharded model (#554)

2022-03-30 18:14:50 +08:00

__init__.py

[refactor] remove old zero code (#517)

2022-03-25 14:54:39 +08:00