yuehuayingxueluo 0aa27f1961 [Inference]Move benchmark-related code to the example directory. (#5408) ...

* move benchmark-related code to the example directory.

* fix bugs in test_fused_rotary_embedding.py

2024-02-28 16:46:03 +08:00

..

benchmark_context_attn_unpad.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_decoding_attn.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_fused_rotary_embedding.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_kv_cache_memcopy.py

[Inference]Add CUDA KVCache Kernel (#5406)

2024-02-28 14:36:50 +08:00

benchmark_rmsnorm_triton.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00

benchmark_rotary_embdding_unpad.py

[Inference]Move benchmark-related code to the example directory. (#5408)

2024-02-28 16:46:03 +08:00