ColossalAI/colossalai/inference/flash_decoding_utils.py at e9032fb0b2bd9d49871e12a5cda987b36ae85dfa - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-24 14:33:28 +00:00

Files

Steve Luo 7806842f2d add paged-attetionv2: support seq length split across thread block (#5707 )

2024-05-14 12:46:54 +08:00

3.0 KiB

Raw Blame History

View Raw