github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-26 01:35:21 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Inference/Kernel]Add get_cos_and_sin Kernel (#5528)

Browse Source 
* Add get_cos_and_sin kernel

* fix code comments

* fix code typos

* merge common codes of get_cos_and_sin kernel.

* Fixed a typo

* Changed 'asset allclose' to 'assert equal'.
This commit is contained in:
yuehuayingxueluo
2024-04-01 13:47:14 +08:00
committed by GitHub
parent 934e31afb2
commit 04aca9e55b
5 changed files with 295 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
extensions/inference/inference_ops_cuda.py
View File

@@ -16,6 +16,7 @@ class InferenceOpsCudaExtension(_CudaExtension):
"cuda/fused_rotary_emb_and_cache_kernel.cu",
"cuda/activation_kernel.cu",
"cuda/rms_layernorm_kernel.cu",
"cuda/get_cos_and_sin_kernel.cu",
]
]
return ret