Jianghai 376533a564 [shardformer] zero1+pp and the corresponding tests (#4517) ...

* pause

* finish pp+zero1

* Update test_shard_vit.py

2023-08-28 10:51:16 +08:00

..

test_layer

[shardformer/sequence parallel] Cherry pick commit to new branch (#4450)

2023-08-16 15:41:20 +08:00

test_model

[shardformer] zero1+pp and the corresponding tests (#4517)

2023-08-28 10:51:16 +08:00

__init__.py

[shardformer] adapted T5 and LLaMa test to use kit (#4049)

2023-07-04 16:05:01 +08:00

test_shard_utils.py

[test] add shard util tests

2023-08-15 23:25:14 +08:00

test_with_torch_ddp.py

[shardformer] support lazy init (#4202)

2023-08-15 23:25:14 +08:00