Jianghai e545a871b8 [Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229) ...

* fix accuracy

* alignment in attention

* fix attention

* fix

* fix bugs

* fix bugs

* fix bugs

2024-01-11 13:46:14 +00:00

..

test_models

[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)

2024-01-11 13:46:14 +00:00

_utils.py

[Inference] Add the logic of the inference engine (#5173)

2024-01-11 13:39:56 +00:00

test_config_and_struct.py

[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)

2024-01-11 13:46:14 +00:00

test_inference_engine.py

[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)

2024-01-11 13:46:14 +00:00

test_kvcache_manager.py

[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)

2024-01-11 13:46:14 +00:00

test_request_handler.py

[Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229)

2024-01-11 13:46:14 +00:00