github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-27 02:03:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
104cbbb313348e04cf83bda9f2dbfbe3b0f369fb
ColossalAI/tests/test_moe
History
HELSON e6d50ec107 [zero] adapt zero for unsharded parameters (#561) 
* support existing sharded and unsharded parameters in zero

* add unitest for moe-zero model init

* polish moe gradient handler
2022-03-31 18:34:11 +08:00
..
test_grad_handler.py
Refactored docstring to google style
2022-03-29 17:17:47 +08:00
test_kernel.py
Refactored docstring to google style
2022-03-29 17:17:47 +08:00
test_moe_group.py
Refactored docstring to google style
2022-03-29 17:17:47 +08:00
test_moe_zero_init.py
[zero] adapt zero for unsharded parameters (#561)
2022-03-31 18:34:11 +08:00
test_moe_zero_model.py
[zero] adapt zero for unsharded parameters (#561)
2022-03-31 18:34:11 +08:00