LuGY 1a49a5ea00 [zero] support shard optimizer state dict of zero (#4194) ...

* support shard optimizer of zero

* polish code

* support sync grad manually

2023-07-31 22:13:29 +08:00

..

test_gemini_checkpoint_io.py

[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)

2023-07-21 14:39:01 +08:00

test_gemini_torch_compability.py

[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)

2023-07-21 14:39:01 +08:00

test_general_checkpoint_io.py

[test] fixed codefactor format report (#4026)

2023-06-16 18:23:02 +08:00

test_low_level_zero_checkpoint_io.py

[zero] support shard optimizer state dict of zero (#4194)

2023-07-31 22:13:29 +08:00

test_torch_ddp_checkpoint_io.py

[checkpointio] sharded optimizer checkpoint for DDP plugin (#4002)

2023-06-16 14:14:05 +08:00

test_torch_fsdp_checkpoint_io.py

[booster] torch fsdp fix ckpt (#3788)

2023-05-23 16:58:45 +08:00

utils.py

[plugin] a workaround for zero plugins' optimizer checkpoint (#3780)

2023-05-19 19:42:31 +08:00