ver217 8c2327b93c impl shard optim v2 and add unit test

2022-03-04 15:27:39 +08:00

..

shard_utils

[zero] a shard strategy in granularity of tensor (#307)

2022-03-04 11:59:35 +08:00

sharded_model

add sharded adam

2022-03-03 16:20:34 +08:00

sharded_optim

impl shard optim v2 and add unit test

2022-03-04 15:27:39 +08:00

sharded_param

[zero] sharded tensor (#305)

2022-03-04 10:46:13 +08:00

__init__.py

added buffer sync to naive amp model wrapper (#291)

2022-03-02 16:47:17 +08:00