Yuanheng Zhao 1513f20f4d [kernel] Add flash decoding triton kernel for blocked kv cache (#5249) ...

* add flash decoding unpad triton kernel

* rename flash decoding kernel

* add kernel testing (draft)

* revise pytest

* support kv group (GQA)

* (trivial) fix api and pytest

* (trivial) func renaming

* (trivial) func/file renaming

* refactor pytest for attention

* (trivial) format and consistent vars of context/decode attn

* (trivial) remove test redundancy

2024-01-11 13:46:14 +00:00

..

cuda_native

fix thrust-transform-reduce error (#5078)

2023-11-21 15:09:35 +08:00

jit

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

triton

[kernel] Add flash decoding triton kernel for blocked kv cache (#5249)

2024-01-11 13:46:14 +00:00

__init__.py

[hotfix] Fix import error: colossal.kernel without triton installed (#4722)

2023-09-14 18:03:55 +08:00

op_builder

[builder] reconfig op_builder for pypi install (#2314)

2023-01-04 16:32:32 +08:00