github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-22 07:14:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
de0468c7a84ba65e735a5ea6285619989e4116e4
ColossalAI/colossalai/zero/init_ctx
History
Jiarui Fang de0468c7a8 [zero] zero init context (#321) 
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
2022-03-11 15:50:28 +08:00
..
__init__.py
[zero] zero init context (#321)
2022-03-11 15:50:28 +08:00
init_context.py
[zero] zero init context (#321)
2022-03-11 15:50:28 +08:00