Files
ColossalAI/examples/language/gpt/requirements.txt
HELSON a7d95b7024 [example] add zero1, zero2 example in GPT examples (#2146)
* [example] add zero1 and zero2 for GPT

* update readme in gpt example

* polish code

* change init value

* update readme
2022-12-20 14:30:27 +08:00

4 lines
58 B
Plaintext

colossalai >= 0.1.12
torch >= 1.8.1
transformers >= 4.231