Frank Lee 1fb0d95df0 [shardformer] made tensor parallelism configurable (#4144) ...

* [shardformer] made tensor parallelism configurable

* polish code

2023-07-04 16:05:01 +08:00

..

__init__.py

[shardformer] adapted T5 and LLaMa test to use kit (#4049)

2023-07-04 16:05:01 +08:00

_utils.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_bert.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_bloom.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_gpt2.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_llama.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_opt.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_t5.py

[shardformer] made tensor parallelism configurable (#4144)

2023-07-04 16:05:01 +08:00

test_shard_vit.py

[shardformer] added embedding gradient check (#4124)

2023-07-04 16:05:01 +08:00