github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-19 09:04:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
6b2f2ab9bb410b7edd722dbfe6ee425de1437c31
ColossalAI/colossalai/nn/parallel
History
ver217 6b2f2ab9bb [ddp] ColoDDP uses bucket all-reduce (#1177) 
* add reducer

* update colo ddp with reducer

* polish unit test

* polish unit test
2022-06-29 10:34:13 +08:00
..
layers
[Tensor] rename parallel_action (#1174)
2022-06-27 10:04:45 +08:00
__init__.py
[ddp] refactor ColoDDP and ZeroDDP (#1146)
2022-06-21 16:35:23 +08:00
data_parallel.py
[ddp] ColoDDP uses bucket all-reduce (#1177)
2022-06-29 10:34:13 +08:00
reducer.py
[ddp] ColoDDP uses bucket all-reduce (#1177)
2022-06-29 10:34:13 +08:00