Jiarui Fang 920c5889a7 [zero] add colo move inline (#521)

2022-03-25 14:02:55 +08:00

..

init_ctx

[zero] add colo move inline (#521)

2022-03-25 14:02:55 +08:00

shard_utils

[zero] fix init device bug in zero init context unittest (#516)

2022-03-25 12:24:18 +08:00

sharded_model

[zero] show model data cuda memory usage after zero context init. (#515)

2022-03-25 11:23:35 +08:00

sharded_optim

[zero] use colo model data api in optimv2 (#511)

2022-03-24 17:19:34 +08:00

sharded_param

[zero] sharded model support the reuse of fp16 shard (#495)

2022-03-23 14:59:59 +08:00

__init__.py

[zero] Update initialize for ZeRO (#458)

2022-03-18 16:18:31 +08:00