ver217 6b2f2ab9bb [ddp] ColoDDP uses bucket all-reduce (#1177) ...

* add reducer

* update colo ddp with reducer

* polish unit test

* polish unit test

2022-06-29 10:34:13 +08:00

..

amp

[hotfix]different overflow status lead to communication stuck. (#1175)

2022-06-27 09:53:57 +08:00

builder

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

cli

[hotfix] fix some bugs caused by size mismatch. (#1011)

2022-05-23 14:02:28 +08:00

communication

[hotfix]fixed p2p process send stuck (#1181)

2022-06-28 14:41:11 +08:00

context

[usability] improved error messages in the context module (#856)

2022-04-25 13:42:31 +08:00

engine

[hotfix]fix some bugs caused by refactored schedule. (#1148)

2022-06-21 22:46:30 +08:00

fx

[fx]add autoparallel passes (#1121)

2022-06-15 16:36:46 +08:00

gemini

[gemini] refactor gemini mgr (#1151)

2022-06-22 11:54:36 +08:00

kernel

[optim] refactor fused sgd (#1134)

2022-06-20 11:19:38 +08:00

logging

[doc] improved docstring in the logging module (#861)

2022-04-25 13:42:00 +08:00

nn

[ddp] ColoDDP uses bucket all-reduce (#1177)

2022-06-29 10:34:13 +08:00

pipeline

[pipeline]add customized policy (#1139)

2022-06-21 15:23:41 +08:00

registry

Remove duplication registry (#1078)

2022-06-08 07:47:24 +08:00

tensor

[ColoTensor] add independent process group (#1179)

2022-06-29 10:03:09 +08:00

testing

[test] skip tests when not enough GPUs are detected (#1090)

2022-06-09 17:19:13 +08:00

trainer

fix issue #1080 (#1071)

2022-06-07 17:21:11 +08:00

utils

[hotfix]different overflow status lead to communication stuck. (#1175)

2022-06-27 09:53:57 +08:00

zero

[zero] sharded optim supports loading local state dict (#1170)

2022-06-24 18:05:16 +08:00

__init__.py

[NFC] polish __init__.py code style (#965)

2022-05-17 10:25:06 +08:00

constants.py

fix typo in constants (#1027)

2022-05-26 08:45:08 +08:00

core.py

[Tensor] distributed view supports inter-process hybrid parallel (#1169)

2022-06-27 09:45:26 +08:00

global_variables.py

[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

initialize.py

[ddp] supported customized torch ddp configuration (#1123)

2022-06-15 18:11:53 +08:00