github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-05 11:02:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Inference]Fix readme and example for API server (#5742)

Browse Source 
* fix chatapi readme and example

* updating doc

* add an api and change the doc

* remove

* add credits and del 'API' heading

* readme

* readme
This commit is contained in:
Jianghai
2024-05-24 10:03:05 +08:00
committed by GitHub
parent 4647ec28c8
commit 85946d4236
5 changed files with 73 additions and 40 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
requirements/requirements.txt
View File

@@ -20,4 +20,6 @@ transformers==4.36.2
peft>=0.7.1
bitsandbytes>=0.39.0
rpyc==6.0.0
fastapi
uvicorn==0.29.0
galore_torch