Baizhou Zhang 38ccb8b1a3 [shardformer] support from_pretrained when loading model with HybridParallelPlugin (#4575) ...

* hybrid plugin support huggingface from_pretrained

* add huggingface compatibility tests

* add folder cleaning

* fix bugs

2023-09-01 17:40:01 +08:00

..

test_gemini_checkpoint_io.py

[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)

2023-07-21 14:39:01 +08:00

test_gemini_torch_compability.py

[checkpointio] Sharded Optimizer Checkpoint for Gemini Plugin (#4302)

2023-07-21 14:39:01 +08:00

test_general_checkpoint_io.py

[test] fixed codefactor format report (#4026)

2023-06-16 18:23:02 +08:00

test_hybrid_huggingface_compatibility.py

[shardformer] support from_pretrained when loading model with HybridParallelPlugin (#4575)

2023-09-01 17:40:01 +08:00

test_hybrid_parallel_plugin_checkpoint_io.py

[shardformer] support sharded optimizer checkpointIO of HybridParallelPlugin (#4540)

2023-08-31 14:50:47 +08:00

test_low_level_zero_checkpoint_io.py

[zero] support shard optimizer state dict of zero (#4194)

2023-07-31 22:13:29 +08:00

test_torch_ddp_checkpoint_io.py

[checkpointio] sharded optimizer checkpoint for DDP plugin (#4002)

2023-06-16 14:14:05 +08:00

test_torch_fsdp_checkpoint_io.py

[booster] torch fsdp fix ckpt (#3788)

2023-05-23 16:58:45 +08:00

utils.py

[plugin] a workaround for zero plugins' optimizer checkpoint (#3780)

2023-05-19 19:42:31 +08:00