hxwang 803878b2fd [moe] full test for deepseek and mixtral (pp + sp to fix)

2024-08-01 10:06:59 +08:00

..

moe_utils.py

[moe] clean legacy code

2024-08-01 10:06:59 +08:00

test_deepseek_layer.py

[shardformer] DeepseekMoE support (#5871)

2024-07-05 16:13:58 +08:00

test_kernel.py

[moe] full test for deepseek and mixtral (pp + sp to fix)

2024-08-01 10:06:59 +08:00

test_moe_checkpoint.py

[moe] init moe plugin comm setting with sp

2024-08-01 10:06:59 +08:00

test_moe_ep_tp.py

[moe] test deepseek

2024-08-01 10:06:59 +08:00

test_moe_ep_zero.py

[moe] test deepseek

2024-08-01 10:06:59 +08:00