yuehuayingxueluo 12f10d5b0b [Fix/Inference]Fix CUDA Rotary Rmbedding GQA (#5623) ...

* fix rotary embedding GQA

* change test_rotary_embdding_unpad.py KH

2024-04-23 13:44:49 +08:00

..

arm

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

common

[Inference] Add Reduce Utils (#5537)

2024-04-01 15:34:25 +08:00

cuda

[Fix/Inference]Fix CUDA Rotary Rmbedding GQA (#5623)

2024-04-23 13:44:49 +08:00

x86

refactor code

2024-03-11 17:06:57 +08:00

__init__.py

[Inference/Refactor] Delete Duplicated code and refactor vec_copy utils and reduce utils (#5593)

2024-04-15 10:57:51 +08:00