Jianghai f47f2fbb24 [Inference] Fix API server, test and example (#5712) ...

* fix api server

* fix generation config

* fix api server

* fix comments

* fix infer hanging bug

* resolve comments, change backend to free port

2024-05-15 15:47:31 +08:00

..

locustfile.py

[Inference] Fix bugs and docs for feat/online-server (#5598)

2024-05-08 15:20:53 +00:00

run_locust.sh

[Inference] Fix API server, test and example (#5712)

2024-05-15 15:47:31 +08:00

test_ci.sh

[Inference] Add example test_ci script

2024-05-09 05:44:05 +00:00