Jiarui Fang ae7d3f4927 [refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

..

layers

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

__init__.py

[ddp] refactor ColoDDP and ZeroDDP (#1146)

2022-06-21 16:35:23 +08:00

data_parallel.py

[Tensor] add cpu group to ddp (#1200)

2022-07-05 14:58:28 +08:00

reducer.py

[ddp] ColoDDP uses bucket all-reduce (#1177)

2022-06-29 10:34:13 +08:00