github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-03 01:19:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,199 Commits 62 Branches 51 Tags
04863a9b144fc7dd46a57d2c7b0cf2f4b351ffb6
Commit Graph

2 Commits

Author SHA1 Message Date
Steve Luo
be396ad6cc [Inference/Kernel] Add Paged Decoding kernel, sequence split within the same thread block (#5531) 
* feat flash decoding for paged attention

* refactor flashdecodingattention

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-04-18 16:45:07 +08:00
yuehuayingxueluo
0aa27f1961 [Inference]Move benchmark-related code to the example directory. (#5408) 
* move benchmark-related code to the example directory.

* fix bugs in test_fused_rotary_embedding.py
 2024-02-28 16:46:03 +08:00