mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-05-09 17:08:23 +00:00
f71e63b0f3
* Refactor MoE Manager setup method * unshard optim ckpt * optim io * update transformer version * update requirements * update ckpt * update ckpt * update ckpt * fix engine * fix engine
6 lines
92 B
Plaintext
6 lines
92 B
Plaintext
colossalai >= 0.3.3
|
|
torch >= 1.8.1
|
|
transformers >= 4.20.0, <= 4.34.0
|
|
sentencepiece
|
|
datasets
|