Jianghai 93aeacca34 [Inference]Update inference config and fix test (#5178) ...

* unify the config setting

* fix test

* fix import

* fix test

* fix

* fix

* add logger

* revise log info

---------

Co-authored-by: CjhHa1 <cjh18671720497outlook.com>

2024-01-11 13:39:29 +00:00

..

_utils.py

[Hotfix] Fix model policy matching strategy in ShardFormer (#5064)

2023-11-22 11:19:39 +08:00

test_config_and_struct.py

[Inference]Update inference config and fix test (#5178)

2024-01-11 13:39:29 +00:00

test_kvcache_manager.py

[Inference]Update inference config and fix test (#5178)

2024-01-11 13:39:29 +00:00