mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-04-11 22:54:10 +00:00
0b00def881
* [example] transfer llama-1 example * [example] fit llama-2 * [example] refactor scripts folder * [example] fit new gemini plugin * [cli] fix multinode runner * [example] fit gemini optim checkpoint * [example] refactor scripts * [example] update requirements * [example] update requirements * [example] rename llama to llama2 * [example] update readme and pretrain script * [example] refactor scripts
10 lines
141 B
Plaintext
10 lines
141 B
Plaintext
colossalai>=0.3.0
|
|
datasets
|
|
numpy
|
|
torch>=1.12.0,<=2.0.0
|
|
tqdm
|
|
transformers
|
|
flash-attn>=2.0.0,<=2.0.5
|
|
SentencePiece==0.1.99
|
|
tensorboard==2.14.0
|