github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-27 18:38:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
104cbbb313348e04cf83bda9f2dbfbe3b0f369fb
ColossalAI/tests/test_zero_data_parallel/common.py
HELSON e6d50ec107 [zero] adapt zero for unsharded parameters (#561) 
* support existing sharded and unsharded parameters in zero

* add unitest for moe-zero model init

* polish moe gradient handler
2022-03-31 18:34:11 +08:00

5.6 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink