ColossalAI/requirements/requirements-infer.txt at df63db7e63d951017fd1fa797fbcaec259fba644 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-11 05:05:35 +00:00

Files

Hongxin Liu 1cd7efc520 [inference] refactor examples and fix schedule (#5077 )

* [setup] refactor infer setup

* [hotfix] fix infenrece behavior on 1 1 gpu

* [exmaple] refactor inference examples

2023-11-21 10:46:03 +08:00

5 lines

217 B

Plaintext

Raw Blame History

 transformers==4.34.0
 auto-gptq==0.5.0
 git+https://github.com/ModelTC/lightllm.git@ece7b43f8a6dfa74027adc77c2c176cff28c76c8
 git+https://github.com/Dao-AILab/flash-attention.git@017716451d446e464dde9aca3a3c1ed2209caaa9