Jiarui Fang 640a6cd304 [refactory] refactory the initialize method for new zero design (#431)

2022-03-16 19:29:37 +08:00

..

init_ctx

use double buffer to handle grad

2022-03-16 14:24:09 +08:00

shard_utils

polish code

2022-03-14 15:48:55 +08:00

sharded_model

sync before creating empty grad

2022-03-16 14:24:09 +08:00

sharded_optim

[refactory] refactory the initialize method for new zero design (#431)

2022-03-16 19:29:37 +08:00

sharded_param

use double buffer to handle grad

2022-03-16 14:24:09 +08:00

__init__.py

[refactory] refactory the initialize method for new zero design (#431)

2022-03-16 19:29:37 +08:00