Steve Luo f7aecc0c6b feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)

2024-03-08 16:21:12 +08:00

..

cuda

feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)

2024-03-08 16:21:12 +08:00

triton

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

__init__.py

[Inference]Add CUDA KVCache Kernel (#5406)

2024-02-28 14:36:50 +08:00