ColossalAI/requirements-infer.txt at bce919708f5ff37f94834d6938a282ed9d2b8108 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-27 11:31:58 +00:00

Cuiqing Li (李崔卿) bce919708f

[Kernels]added flash-decoidng of triton (#5063 )

* added flash-decoidng of triton based on lightllm kernel

* add req

* clean

* clean

* delete build.sh

---------

Co-authored-by: cuiqing.li <lixx336@gmail.com>

2023-11-20 13:58:29 +08:00

8 lines

304 B

Plaintext

Raw Blame History

 transformers==4.34.0
 packaging
 ninja
 auto-gptq==0.5.0
 git+https://github.com/ModelTC/lightllm.git@ece7b43f8a6dfa74027adc77c2c176cff28c76c8
 git+https://github.com/facebookresearch/xformers.git@main#egg=xformers
 git+https://github.com/Dao-AILab/flash-attention.git@017716451d446e464dde9aca3a3c1ed2209caaa9