github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-04 22:48:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
a1e39f4c0d
ColossalAI/extensions/pybind
History
Steve Luo 7806842f2d
add paged-attetionv2: support seq length split across thread block ()
2024-05-14 12:46:54 +08:00
..
cpu_adam [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
flash_attention [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
inference add paged-attetionv2: support seq length split across thread block () 2024-05-14 12:46:54 +08:00
layernorm [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
moe [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
optimizer [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
softmax [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00
__init__.py [Inference/Refactor] Refactor compilation mechanism and unified multi hw () 2024-04-24 14:17:54 +08:00