ColossalAI/examples/language/openmoe/requirements.txt
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
2023-11-02 02:21:24 +00:00

6 lines
81 B
Plaintext

colossalai >= 0.3.3
torch >= 1.8.1
transformers >= 4.20.0
sentencepiece
datasets