Wenhao Chen 3c08f17348 [hotfix]: modify create_ep_hierarchical_group and add test (#5032) ...

* feat: modify create_ep_hierarchical_group args

* test: add ep tests

* fix: remove get_process_group_ranks

* fix: fix src_rank

2023-11-17 10:53:00 +08:00

..

moe_utils.py

[moe]: fix ep/tp tests, add hierarchical all2all (#4982)

2023-11-09 06:31:00 +00:00

test_grad_handler.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_kernel.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_checkpoint.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_ep_tp.py

[hotfix]: modify create_ep_hierarchical_group and add test (#5032)

2023-11-17 10:53:00 +08:00

test_moe_group.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_hybrid_zero.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_load_balance.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_router.py

[moe]: fix ep/tp tests, add hierarchical all2all (#4982)

2023-11-09 06:31:00 +00:00

test_moe_zero_fwd_bwd.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

test_moe_zero_optim.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00