Jianghai df0aa49585 [Inference] Kernel Fusion, fused copy kv cache into rotary embedding (#5336) ...

* revise rotary embedding

* remove useless print

* adapt

2024-01-31 16:31:29 +08:00

..

jit

[npu] change device to accelerator api (#5239)

2024-01-09 10:20:05 +08:00

triton

[Inference] Kernel Fusion, fused copy kv cache into rotary embedding (#5336)

2024-01-31 16:31:29 +08:00

__init__.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

extensions

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

kernel_loader.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00