github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-11 14:43:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
f79963199cd30c5e917d430aedd79113d06d608c
ColossalAI/colossalai/inference/modeling
History
yuehuayingxueluo f79963199c [inference]Add alibi to flash attn function (#5678) 
* add alibi to flash attn function

* rm redundant modifications
2024-04-30 19:35:05 +08:00
..
layers
[Inference] Adapt Baichuan2-13B TP (#5659)
2024-04-30 15:47:07 +08:00
models
[inference]Add alibi to flash attn function (#5678)
2024-04-30 19:35:05 +08:00
policy
[Inference] Adapt Baichuan2-13B TP (#5659)
2024-04-30 15:47:07 +08:00
__init__.py
[doc] updated inference readme (#5343)
2024-02-02 14:31:10 +08:00