Steve Luo f7aecc0c6b feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)

2024-03-08 16:21:12 +08:00

..

benchmark_context_attn_unpad.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_decoding_attn.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_fused_rotary_embedding.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_kv_cache_memcopy.py

[Inference]Add CUDA KVCache Kernel (#5406)

2024-02-28 14:36:50 +08:00

benchmark_rmsnorm.py

feat rmsnorm cuda kernel and add unittest, benchmark script (#5417)

2024-03-08 16:21:12 +08:00

benchmark_rotary_embdding_unpad.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00