ColossalAI/examples/inference/client
Jianghai f47f2fbb24
[Inference] Fix API server, test and example (#5712)
* fix api server

* fix generation config

* fix api server

* fix comments

* fix infer hanging bug

* resolve comments, change backend to free port
2024-05-15 15:47:31 +08:00
..
locustfile.py [Inference] Fix bugs and docs for feat/online-server (#5598) 2024-05-08 15:20:53 +00:00
run_locust.sh [Inference] Fix API server, test and example (#5712) 2024-05-15 15:47:31 +08:00
test_ci.sh [Inference] Add example test_ci script 2024-05-09 05:44:05 +00:00