54 Commits

Author	SHA1	Message	Date
ver217	e396bb71f2	[zero] add tensor placement policies (#743) ... * add tensor placement policies * polish comments * polish comments * update moe unit tests	2022-04-13 15:00:48 +08:00
HELSON	22c4b88d56	[zero] refactor ShardedParamV2 for convenience (#742)	2022-04-13 14:54:26 +08:00
Frank Lee	f4f42d4c3c	[bug] fixed DDP compatibility with torch 1.8 (#739)	2022-04-13 00:08:46 +08:00
Jiarui Fang	53cb584808	[utils] correct cpu memory used and capacity in the context of multi-process (#726)	2022-04-12 14:57:54 +08:00