flybird11111 3e02154710 [gemini] gemini support extra-dp (#5043) ...

* support ddp

* fix

* fix

* fix

fix

* support ddp

* fix

* fix

* fix

fix

* simplify tests

* fix

* fix

* fix

fix

fix

* fix

2023-11-16 21:03:04 +08:00

..

gemini

[gemini] gemini support extra-dp (#5043)

2023-11-16 21:03:04 +08:00

low_level

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

2023-11-03 13:32:43 +08:00

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

wrapper.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00