littsk 83b52c56cd [feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837) ...

* Add clip_grad_norm for hibrid_parallel_plugin

* polish code

* add unittests

* Move tp to a higher-level optimizer interface.

* bug fix

* polish code

2023-10-12 11:32:37 +08:00

..

gemini

[gemini] support amp o3 for gemini (#4872)

2023-10-12 10:39:08 +08:00

low_level

[feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837)

2023-10-12 11:32:37 +08:00

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

wrapper.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00