ver217 8106d7b8c7 [ddp] refactor ColoDDP and ZeroDDP (#1146) ...

* ColoDDP supports overwriting default process group

* rename ColoDDPV2 to ZeroDDP

* add docstr for ZeroDDP

* polish docstr

2022-06-21 16:35:23 +08:00

..

_ops

embedding op use gather_out (#1143)

2022-06-21 13:21:20 +08:00

layer

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

loss

[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)

2022-04-02 16:12:04 +08:00

lr_scheduler

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

metric

[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)

2022-04-02 16:12:04 +08:00

optimizer

[optim] refactor fused sgd (#1134)

2022-06-20 11:19:38 +08:00

parallel

[ddp] refactor ColoDDP and ZeroDDP (#1146)

2022-06-21 16:35:23 +08:00

__init__.py

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

init.py

Refactored docstring to google style

2022-03-29 17:17:47 +08:00