[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048)

Browse Source

* [example] pass use_fp8_comm flag to all plugins

* [example] add mixtral benchmark

* [moe] refine assertion and check

* [moe] fix mixtral & add more tests

* [moe] consider checking dp * sp group and moe_dp_group

* [mixtral] remove gate tp & add more tests

* [deepseek] fix tp & sp for deepseek

* [mixtral] minor fix

* [deepseek] add deepseek benchmark

...

This commit is contained in:

botbw

2024-09-10 17:30:53 +08:00

committed by GitHub

parent 8fd25d6e09

commit c54c4fcd15

21 changed files with 907 additions and 99 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

examples/language/mixtral/test_ci.sh Executable file