8 Commits

Author	SHA1	Message	Date
Jiarui Fang	c11ff81b15	[zero] get memory usage of sharded optim v2. (#542)	2022-03-29 09:08:18 +08:00
Jiarui Fang	705f56107c	[zero] refactor model data tracing (#537)	2022-03-28 16:38:18 +08:00
Jiarui Fang	05e33b2578	[zero] fix grad offload (#528) ... * [zero] fix grad offload * polish code	2022-03-25 18:23:25 +08:00
Jiarui Fang	8d8c5407c0	[zero] refactor model data tracing (#522)	2022-03-25 18:03:32 +08:00
Jiarui Fang	920c5889a7	[zero] add colo move inline (#521)	2022-03-25 14:02:55 +08:00
Jiarui Fang	0bebda6ea5	[zero] fix init device bug in zero init context unittest (#516)	2022-03-25 12:24:18 +08:00
Jiarui Fang	9330be0f3c	[memory] set cuda mem frac (#506)	2022-03-24 16:57:13 +08:00
Jiarui Fang	0035b7be07	[memory] add model data tensor moving api (#503)	2022-03-24 14:29:41 +08:00