Xu Kai fb103cfd6e [inference] update examples and engine (#5073) ...

* update examples and engine

* fix choices

* update example

2023-11-20 19:44:52 +08:00

..

_utils.py

[hotfix] Suport extra_kwargs in ShardConfig (#5031)

2023-11-10 10:49:50 +08:00

test_hybrid_bloom.py

[inference] update examples and engine (#5073)

2023-11-20 19:44:52 +08:00

test_hybrid_chatglm2.py

[inference] update examples and engine (#5073)

2023-11-20 19:44:52 +08:00

test_hybrid_llama.py

[inference] update examples and engine (#5073)

2023-11-20 19:44:52 +08:00

test_kvcache_manager.py

[inference] Refactor inference architecture (#5057)

2023-11-19 21:05:05 +08:00