6 Commits

Author	SHA1	Message	Date
HELSON	b28991dd0a	[feature] A new ZeRO implementation (#1644)	2022-10-09 09:18:51 +08:00
Jiarui Fang	c5d39215f6	Revert "[feature] new zero implementation (#1623)" (#1643) ... This reverts commit 5be118f405.	2022-09-26 10:06:03 +08:00
HELSON	5be118f405	[feature] new zero implementation (#1623)	2022-09-24 19:58:18 +08:00
HELSON	b80340168e	[zero] add chunk_managerV2 for all-gather chunk (#1441)	2022-08-11 19:17:24 +08:00
HELSON	9056677b13	[zero] add chunk size searching algorithm for parameters in different groups (#1436)	2022-08-11 13:32:19 +08:00
HELSON	039b7ed3bc	[polish] add update directory in gemini; rename AgChunk to ChunkV2 (#1432)	2022-08-10 16:40:29 +08:00