github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-22 15:26:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
199 Commits 59 Branches 51 Tags
907ac4a2dc71678efe5929da69dded795696c2ee
Commit Graph

2 Commits

Author SHA1 Message Date
1SAA
82023779bb Added TPExpert for special situation 2022-03-11 15:50:28 +08:00
1SAA
219df6e685 Optimized MoE layer and fixed some bugs; 
Decreased moe tests;

Added FFNExperts and ViTMoE model
 2022-03-11 15:50:28 +08:00