5 Commits

Author	SHA1	Message	Date
Jiarui Fang	2f95df5934	[zero] able to place params on cpu after zero init context (#365) ... * place params on cpu after zero init context * polish code	2022-03-10 14:08:58 +08:00
Jiarui Fang	7650177713	[zero] global model data memory tracer (#360)	2022-03-10 11:20:04 +08:00
ver217	ce5a7dcab0	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-08 18:18:06 +08:00
Jiarui Fang	cec05b25c9	[zero] update zero context init with the updated test utils (#327)	2022-03-08 14:45:01 +08:00
Jiarui Fang	d6abd933f2	[zero] zero init context (#321) ... * add zero init context * add more flags for zero init context fix bug of repeated converting param to ShardedParamV2 * polish code	2022-03-07 16:14:40 +08:00