flybird11111 59e252ecdb [shardformer] chatglm support sequence parallel (#4482) ...

* [shardformer] chatglm support sequence parallel

[shardformer] chatglm support sequence parallel

[shardformer] chatglm support sequence parallel

[shardformer] chatglm support sequence parallel

[shardformer] chatglm support sequence parallel

[shardformer] chatglm support sequence parallel

* fix

fix

fix

fix

2023-08-22 23:59:31 +08:00

..

__init__.py

rename chatglm to chatglm2 (#4484)

2023-08-22 14:13:31 +08:00

albert.py

[test] added transformers models to test model zoo (#3135)

2023-03-15 11:26:10 +08:00

bert.py

[shardformer] update tests for all optimization (#4413)

2023-08-15 23:25:14 +08:00

blip2.py

[Shardformer] Merge flash attention branch to pipeline branch (#4362)

2023-08-15 23:25:14 +08:00

bloom.py

[shardformer] rewrite tests for opt/bloom/llama/vit/chatglm (#4395)

2023-08-15 23:25:14 +08:00

chatglm2.py

[shardformer] chatglm support sequence parallel (#4482)

2023-08-22 23:59:31 +08:00

gpt.py

[Shardformer] Merge flash attention branch to pipeline branch (#4362)

2023-08-15 23:25:14 +08:00

llama.py

[shardformer] adapted T5 and LLaMa test to use kit (#4049)

2023-07-04 16:05:01 +08:00

opt.py

[test] Hotfix/fix some model test and refactor check util api (#4369)

2023-08-15 23:25:14 +08:00

sam.py

[shardformer] support SAM (#4231)

2023-08-15 23:25:14 +08:00

t5.py

[shardformer]update t5 tests for using all optimizations. (#4407)

2023-08-15 23:25:14 +08:00

vit.py

[shardformer] rewrite tests for opt/bloom/llama/vit/chatglm (#4395)

2023-08-15 23:25:14 +08:00

whisper.py

[Shardformer] Merge flash attention branch to pipeline branch (#4362)

2023-08-15 23:25:14 +08:00