genghaozhe d22bf30ca6 implement auto policy prefetch and modify a little origin code.

2024-05-20 04:01:53 +00:00

..

gemini

implement auto policy prefetch and modify a little origin code.

2024-05-20 04:01:53 +00:00

low_level

[Feature] Distributed optimizers: Lamb, Galore, CAME and Adafactor (#5694)

2024-05-14 13:52:45 +08:00

__init__.py

[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)

2023-11-28 16:54:42 +08:00

wrapper.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00