ColossalAI/colossalai/inference/flash_decoding_utils.py at main - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-21 22:24:00 +00:00

Files

Steve Luo 7806842f2d add paged-attetionv2: support seq length split across thread block (#5707 )

2024-05-14 12:46:54 +08:00

3.0 KiB

Raw Permalink Blame History

View Raw