github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-04-28 03:43:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
c064032865
ColossalAI/examples/inference
History
Jianghai c064032865 [Online Server] Chat Api for streaming and not streaming response (#5470) 
* fix bugs

* fix bugs

* fix api server

* fix api server

* add chat api and test

* del request.n
2024-05-08 15:20:53 +00:00
..
benchmark_ops [Fix] Fix Inference Example, Tests, and Requirements (#5688) 2024-05-08 11:30:15 +08:00
client [Online Server] Chat Api for streaming and not streaming response (#5470) 2024-05-08 15:20:53 +00:00
llama [Fix] Fix Inference Example, Tests, and Requirements (#5688) 2024-05-08 11:30:15 +08:00