Files
ColossalAI/colossalai/zero/init_ctx/__init__.py
Jiarui Fang d6abd933f2 [zero] zero init context (#321)
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
2022-03-07 16:14:40 +08:00

4 lines
73 B
Python

from .init_context import ZeroInitContext
__all__ = ['ZeroInitContext']