github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-12 10:54:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
725fbd2ed067f9c58ac04670377d3e6f2a96fe00
ColossalAI/colossalai/inference/modeling
History
yuehuayingxueluo f79963199c [inference]Add alibi to flash attn function (#5678) 
* add alibi to flash attn function

* rm redundant modifications
2024-04-30 19:35:05 +08:00
..
layers
[Inference] Adapt Baichuan2-13B TP (#5659)
2024-04-30 15:47:07 +08:00
models
[inference]Add alibi to flash attn function (#5678)
2024-04-30 19:35:05 +08:00
policy
[Inference] Adapt Baichuan2-13B TP (#5659)
2024-04-30 15:47:07 +08:00
__init__.py
[doc] updated inference readme (#5343)
2024-02-02 14:31:10 +08:00