ColossalAI/requirements-infer.txt at fb103cfd6e91dc1f72e884099aaed84ce5e198cf - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-28 03:43:01 +00:00

Xu Kai fb103cfd6e

[inference] update examples and engine (#5073 )

* update examples and engine

* fix choices

* update example

2023-11-20 19:44:52 +08:00

7 lines

233 B

Plaintext

Raw Blame History

 transformers==4.34.0
 packaging
 ninja
 auto-gptq==0.5.0
 git+https://github.com/ModelTC/lightllm.git@ece7b43f8a6dfa74027adc77c2c176cff28c76c8
 git+https://github.com/Dao-AILab/flash-attention.git@017716451d446e464dde9aca3a3c1ed2209caaa9