Baizhou Zhang 64a08b2dc3 [checkpointio] support unsharded checkpointIO for hybrid parallel (#4774) ...

* support unsharded saving/loading for model

* support optimizer unsharded saving

* update doc

* support unsharded loading for optimizer

* small fix

2023-09-26 10:58:03 +08:00

..

test_gemini_checkpoint_io.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_gemini_torch_compability.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_general_checkpoint_io.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_hybrid_parallel_plugin_checkpoint_io.py

[checkpointio] support unsharded checkpointIO for hybrid parallel (#4774)

2023-09-26 10:58:03 +08:00

test_low_level_zero_checkpoint_io.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_plugins_huggingface_compatibility.py

[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)

2023-09-20 18:29:37 +08:00

test_torch_ddp_checkpoint_io.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_torch_fsdp_checkpoint_io.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

utils.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00