github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-12-19 02:22:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,833 Commits 60 Branches 51 Tags
c4fe9e812ed6880b51bd3a7b6dc12cf81b402a21
Commit Graph

3 Commits

Author SHA1 Message Date
Yuanheng Zhao
8754abae24 [Fix] Fix & Update Inference Tests (compatibility w/ main) 2024-05-05 16:28:56 +00:00
Yuanheng Zhao
5be590b99e [kernel] Support new KCache Layout - Context Attention Triton Kernel (#5658) 
* add context attn triton kernel - new kcache layout

* add benchmark triton

* tiny revise

* trivial - code style, comment
 2024-04-26 17:51:49 +08:00
yuehuayingxueluo
0aa27f1961 [Inference]Move benchmark-related code to the example directory. (#5408) 
* move benchmark-related code to the example directory.

* fix bugs in test_fused_rotary_embedding.py
 2024-02-28 16:46:03 +08:00