github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-23 10:30:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
feat/speculative-decoding
ColossalAI/extensions/inference
History
yuehuayingxueluo 04aca9e55b [Inference/Kernel]Add get_cos_and_sin Kernel (#5528) 
* Add get_cos_and_sin kernel

* fix code comments

* fix code typos

* merge common codes of get_cos_and_sin kernel.

* Fixed a typo

* Changed 'asset allclose' to 'assert equal'.
2024-04-01 13:47:14 +08:00
..
__init__.py
[Inference]Add CUDA KVCache Kernel (#5406)
2024-02-28 14:36:50 +08:00
inference_ops_cuda.py
[Inference/Kernel]Add get_cos_and_sin Kernel (#5528)
2024-04-01 13:47:14 +08:00