github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-12 02:38:52 +00:00
Code Issues Packages Projects Releases Wiki Activity
164 Commits 62 Branches 51 Tags
a77d73f22be42e995ea4c7ede7dbe170194299cd
Commit Graph

4 Commits

Author SHA1 Message Date
1SAA
82023779bb Added TPExpert for special situation 2022-03-11 15:50:28 +08:00
1SAA
219df6e685 Optimized MoE layer and fixed some bugs; 
Decreased moe tests;

Added FFNExperts and ViTMoE model
 2022-03-11 15:50:28 +08:00
HELSON
1ff5be36c2 Added moe parallel example (#140) 2022-01-17 15:34:04 +08:00
HELSON
dceae85195 Added MoE parallel (#127) 2022-01-07 15:08:36 +08:00