doubleHU f2da21a827 fix format (#586)

2022-04-06 11:40:59 +08:00

..

__init__.py

fix format (#585)

2022-04-06 11:40:59 +08:00

_base_gradient_handler.py

fix format (#586)

2022-04-06 11:40:59 +08:00

_data_parallel_gradient_handler.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

_moe_gradient_handler.py

[refactor] memory utils (#577)

2022-04-01 09:22:33 +08:00

_pipeline_parallel_gradient_handler.py

[zero] ZeRO supports pipeline parallel (#477)

2022-03-21 16:55:37 +08:00

_sequence_parallel_gradient_handler.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00

_zero_gradient_handler.py

Flake8 code restyle

2022-03-11 15:50:28 +08:00

utils.py

add moe context, moe utilities and refactor gradient handler (#455)

2022-03-18 16:38:32 +08:00