LuGY dd7cc58299 [zero] add state dict for low level zero (#4179) ...

* add state dict for zero

* fix unit test

* polish

2023-07-31 22:13:29 +08:00

..

test_grad_acc.py

[zero]support no_sync method for zero1 plugin (#4138)

2023-07-31 22:13:29 +08:00

test_zero1_2.py

[zero] refactor low level zero for shard evenly (#4030)

2023-07-31 22:13:29 +08:00

test_zero_ckpt.py

[zero] add state dict for low level zero (#4179)

2023-07-31 22:13:29 +08:00

test_zero_init.py

[zero] allow passing process group to zero12 (#4153)

2023-07-31 22:13:29 +08:00

test_zero_tp.py

[zero] allow passing process group to zero12 (#4153)

2023-07-31 22:13:29 +08:00