ColossalAI/extensions/pybind at 5cd75ce4c7edc95bacd8ec5fc04b8add339e8331 - ColossalAI - Gitea: Git with a cup of tea at home

github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-02-21 06:22:09 +00:00

Files

History

Steve Luo 5cd75ce4c7 [Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663 )

* refactor kvcache manager and rotary_embedding and kvcache_memcpy operator

* refactor decode_kv_cache_memcpy

* enable alibi in pagedattention

2024-04-30 15:52:23 +08:00

..

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

flash_attention

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

[Inference/Kernel] refactor kvcache manager and rotary_embedding and kvcache_memcpy oper… (#5663 )

2024-04-30 15:52:23 +08:00

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00

__init__.py

[Inference/Refactor] Refactor compilation mechanism and unified multi hw (#5613 )

2024-04-24 14:17:54 +08:00