github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-08-09 00:34:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,496 Commits 62 Branches 51 Tags
6a9164a477591c9c8eaecbaef64fa111cee3a49c
Commit Graph

3 Commits

Author SHA1 Message Date
Luo Yihang
e239cf9060 [hotfix] fix typo of openmoe model source (#5403) 2024-03-05 21:44:38 +08:00
Xuanlei Zhao
f71e63b0f3 [moe] support optimizer checkpoint (#5015) 
* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine
 2023-11-08 15:07:03 +00:00
Xuanlei Zhao
dc003c304c [moe] merge moe into main (#4978) 
* update moe module
* support openmoe
 2023-11-02 02:21:24 +00:00