ColossalAI/colossalai/inference/flash_decoding_utils.py at 77a219a082cb2c5aa9fe9d74fa8c233a514d8bd8 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-03 01:19:15 +00:00

Files

Steve Luo 7806842f2d add paged-attetionv2: support seq length split across thread block (#5707 )

2024-05-14 12:46:54 +08:00

3.0 KiB

Raw Blame History

View Raw