flybird11111 46e091651b [shardformer] hybridparallelplugin support gradients accumulation. (#5246) ...

* support gradients acc

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

fix

* fix

fix

* fix

fix

fix

2024-01-17 15:22:33 +08:00

..

__init__.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

dp_plugin_base.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

gemini_plugin.py

fix-test (#5210)

2024-01-03 14:26:13 +08:00

hybrid_parallel_plugin.py

[shardformer] hybridparallelplugin support gradients accumulation. (#5246)

2024-01-17 15:22:33 +08:00

low_level_zero_plugin.py

[npu] add npu support for gemini and zero (#5067)

2023-11-20 16:12:41 +08:00

moe_hybrid_parallel_plugin.py

[moe] support optimizer checkpoint (#5015)

2023-11-08 15:07:03 +00:00

plugin_base.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

pp_plugin_base.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

torch_ddp_plugin.py

[doc] polish shardformer doc (#4779)

2023-09-26 10:57:47 +08:00

torch_fsdp_plugin.py

[doc] polish shardformer doc (#4779)

2023-09-26 10:57:47 +08:00