Jiarui Fang 237d08e7ee [zero] hybrid cpu adam (#445)

2022-03-17 15:05:41 +08:00

..

init_ctx

use double buffer to handle grad

2022-03-16 14:24:09 +08:00

shard_utils

polish code

2022-03-14 15:48:55 +08:00

sharded_model

[hotfix] fix initialize bug with zero (#442)

2022-03-17 13:16:22 +08:00

sharded_optim

[refactory] refactory the initialize method for new zero design (#431)

2022-03-16 19:29:37 +08:00

sharded_param

use double buffer to handle grad

2022-03-16 14:24:09 +08:00

__init__.py

[zero] hybrid cpu adam (#445)

2022-03-17 15:05:41 +08:00