10 Commits

Author	SHA1	Message	Date
HELSON	a4ed9125ac	[hotfix] fix lightning error (#2529)	2023-01-31 10:40:39 +08:00
HELSON	ea13a201bb	[polish] polish code for get_static_torch_model (#2405) ... * [gemini] polish code * [testing] remove code * [gemini] make more robust	2023-01-09 17:41:38 +08:00
eric8607242	9880fd2cd8	Fix state_dict key missing issue of the ZeroDDP (#2363) ... * Fix state_dict output for ZeroDDP duplicated parameters * Rewrite state_dict based on get_static_torch_model * Modify get_static_torch_model to be compatible with the lower version (ZeroDDP)	2023-01-09 14:35:14 +08:00
HELSON	48d33b1b17	[gemini] add get static torch model (#2356)	2023-01-06 13:41:19 +08:00
Jiarui Fang	af32022f74	[Gemini] fix the convert_to_torch_module bug (#2269)	2023-01-03 15:55:35 +08:00
Jiarui Fang	2827f41898	[Gemini] GeminiDPP convert to PyTorch Module. (#2151)	2022-12-20 10:19:36 +08:00
Jiarui Fang	e99edfcb51	[NFC] polish comments for Chunk class (#2116)	2022-12-12 15:39:31 +08:00
HELSON	b28991dd0a	[feature] A new ZeRO implementation (#1644)	2022-10-09 09:18:51 +08:00
Jiarui Fang	c5d39215f6	Revert "[feature] new zero implementation (#1623)" (#1643) ... This reverts commit 5be118f405.	2022-09-26 10:06:03 +08:00
HELSON	5be118f405	[feature] new zero implementation (#1623)	2022-09-24 19:58:18 +08:00