github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-10 07:04:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
de378cd2abd77b464786dc5f8298c9edbf023fbc
ColossalAI/extensions/pybind/inference/inference.cpp
Steve Luo 5cd75ce4c7 [Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663) 
* refactor kvcache manager and rotary_embedding and kvcache_memcpy operator

* refactor decode_kv_cache_memcpy

* enable alibi in pagedattention
2024-04-30 15:52:23 +08:00

4.8 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink