ColossalAI/colossalai/nn/parallel/__init__.py at 8e4e8601b7b339d7028a09cd1cbfe5e2e324efd6 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-20 17:44:17 +00:00

Files

HELSON b528eea0f0 [zero] add zero wrappers (#2523 )

* [zero] add zero wrappers

* change names

* add wrapper functions to init

2023-01-29 17:52:58 +08:00

6 lines

239 B

Python

Raw Blame History

 from .data_parallel import ColoDDP, ZeroDDP
 from .gemini_parallel import GeminiDDP
 from .zero_wrapper import zero_model_wrapper, zero_optim_wrapper
 __all__ = ['ColoDDP', 'ZeroDDP', 'GeminiDDP', 'zero_model_wrapper', 'zero_optim_wrapper']