flybird11111 21e0a42fd1 [shardformer]fix, test gpt2 for AMP+TP (#4403) ...

* [shardformer] gpt2 tests fix

[shardformer] test all optimizations (#4399)

[shardformer] test all optimizations

[shardformer] test all optimizations

[shardformer] test all optimizations

[shardformer] gpt2 tests fix

* [shardformer] gpt2 tests fix

2023-08-15 23:25:14 +08:00

..

test_layer

update some module with new api version

2023-08-15 23:25:14 +08:00

test_model

[shardformer]fix, test gpt2 for AMP+TP (#4403)

2023-08-15 23:25:14 +08:00

__init__.py

[shardformer] adapted T5 and LLaMa test to use kit (#4049)

2023-07-04 16:05:01 +08:00

test_shard_utils.py

[test] add shard util tests

2023-08-15 23:25:14 +08:00

test_with_torch_ddp.py

[shardformer] support lazy init (#4202)

2023-08-15 23:25:14 +08:00