Hongxin Liu f313babd11 [gemini] support save state dict in shards (#3581) ...

* [gemini] support state dict shard

* [gemini] add test state dict shard

* [gemini] polish docstr

* [gemini] fix merge

* [gemini] polish code

2023-04-17 17:11:09 +08:00

..

components_to_test

[testing] add beit model for unit testings (#2196)

2022-12-26 17:35:36 +08:00

kit

[FX] refactor experimental tracer and adapt it with hf models (#3157)

2023-03-22 10:40:33 +08:00

test_amp

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_analyzer

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_auto_parallel

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_autochunk

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_booster

[gemini] gemini supports lazy init (#3379)

2023-04-12 16:03:25 +08:00

test_checkpoint_io

[checkpoint] support huggingface style sharded checkpoint (#3461)

2023-04-06 16:23:39 +08:00

test_cluster

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_comm

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_config

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

test_context

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_data

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_data_pipeline_tensor_parallel

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_ddp

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_device

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_engine

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_fx

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_layers

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_moe

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_ops

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_optimizer

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_pipeline

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_tensor

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_trainer

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_utils

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_zero

[gemini] support save state dict in shards (#3581)

2023-04-17 17:11:09 +08:00

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00