github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-05 02:51:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,703 Commits 59 Branches 51 Tags
supercooledith-patch-1
Commit Graph

2 Commits

Author SHA1 Message Date
Jianghai
61a1b2e798 [Inference] Fix bugs and docs for feat/online-server () 
* fix test bugs

* add do sample test

* del useless lines

* fix comments

* fix tests

* delete version tag

* delete version tag

* add

* del test sever

* fix test

* fix

* Revert "add"

This reverts commit b9305fb024.
 2024-05-08 15:20:53 +00:00
Jianghai
69cd7e069d [Inference] ADD async and sync Api server using FastAPI () 
* add api server

* fix

* add

* add completion service and fix bug

* add generation config

* revise shardformer

* fix bugs

* add docstrings and fix some bugs

* fix bugs and add choices for prompt template
 2024-05-08 15:18:28 +00:00