Files
ColossalAI/colossalai/zero/init_ctx/__init__.py
Jiarui Fang de0468c7a8 [zero] zero init context (#321)
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
2022-03-11 15:50:28 +08:00

4 lines
73 B
Python

from .init_context import ZeroInitContext
__all__ = ['ZeroInitContext']