github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-25 17:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
139 Commits 62 Branches 51 Tags
af2cfed44769dfd822edbdfff0052472c69f55fc
Commit Graph

2 Commits

Author SHA1 Message Date
1SAA
adf7e50325 Added TPExpert for special situation 2022-02-28 13:55:35 +08:00
1SAA
e7a1136436 Optimized MoE layer and fixed some bugs; 
Decreased moe tests;

Added FFNExperts and ViTMoE model
 2022-02-22 10:27:12 +08:00