Baizhou Zhang c0a033700c [shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758) ...

* fix master param sync for hybrid plugin

* rewrite unwrap for ddp/fsdp

* rewrite unwrap for zero/gemini

* rewrite unwrap for hybrid plugin

* fix geemini unwrap

* fix bugs

2023-09-20 18:29:37 +08:00

..

components_to_test

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

kit

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_analyzer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_auto_parallel

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_autochunk

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_booster

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_checkpoint_io

[shardformer] fix master param sync for hybrid plugin/rewrite unwrapping logic (#4758)

2023-09-20 18:29:37 +08:00

test_cluster

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_config

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_device

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_fx

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_infer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_infer_ops

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_lazy

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_legacy

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_moe

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_optimizer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_pipeline

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_shardformer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_tensor

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_utils

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_zero

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00