Hongxin Liu c068ef0fa0 [zero] support all-gather overlap (#5898) ...

* [zero] support all-gather overlap

* [zero] add overlap all-gather flag

* [misc] fix typo

* [zero] update api

2024-07-11 18:59:59 +08:00

..

gemini

[gemini] fixes for benchmarking (#5847)

2024-06-26 15:52:09 +08:00

low_level

[zero] support all-gather overlap (#5898)

2024-07-11 18:59:59 +08:00

__init__.py

[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)

2023-11-28 16:54:42 +08:00

wrapper.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00