Files
ColossalAI/colossalai/nn/parallel/__init__.py
ver217 8106d7b8c7 [ddp] refactor ColoDDP and ZeroDDP (#1146)
* ColoDDP supports overwriting default process group

* rename ColoDDPV2 to ZeroDDP

* add docstr for ZeroDDP

* polish docstr
2022-06-21 16:35:23 +08:00

4 lines
78 B
Python

from .data_parallel import ColoDDP, ZeroDDP
__all__ = ['ColoDDP', 'ZeroDDP']