Hongxin Liu c068ef0fa0 [zero] support all-gather overlap (#5898) ...

* [zero] support all-gather overlap

* [zero] add overlap all-gather flag

* [misc] fix typo

* [zero] update api

2024-07-11 18:59:59 +08:00

..

test_grad_acc.py

[zero] support all-gather overlap (#5898)

2024-07-11 18:59:59 +08:00

test_mem_leak.py

[MoE/ZeRO] Moe refactor with zero refactor (#5821)

2024-06-28 14:00:08 +08:00

test_zero1_2.py

[zero] support all-gather overlap (#5898)

2024-07-11 18:59:59 +08:00

test_zero_ckpt.py

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00