Jianghai 730103819d [Inference]Fused kv copy into rotary calculation (#5383) ...

* revise rotary embedding

* remove useless print

* adapt

* fix

* add

* fix

* modeling

* fix

* fix

* fix

* fused kv copy

* fused copy

* colossalai/kernel/triton/no_pad_rotary_embedding.py

* del padding llama

* del

2024-02-21 11:31:48 +08:00

..

jit

[npu] change device to accelerator api (#5239)

2024-01-09 10:20:05 +08:00

triton

[Inference]Fused kv copy into rotary calculation (#5383)

2024-02-21 11:31:48 +08:00

__init__.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

extensions

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00

kernel_loader.py

[feat] refactored extension module (#5298)

2024-01-25 17:01:48 +08:00