add use cases: tool_use_with_plugin, and how to write a plugin.

This commit is contained in:
xuyuan23
2023-06-14 17:24:31 +08:00
parent 25c34cb48f
commit 7b77360286
6 changed files with 182 additions and 4 deletions

View File

@@ -57,6 +57,11 @@ If you have difficulty with this step, you can also directly use the model from
$ python pilot/server/llmserver.py
```
Starting `llmserver.py` with the following command will result in a relatively stable Python service with multiple processes.
```bash
$ gunicorn llmserver:app -w 4 -k uvicorn.workers.UvicornWorker -b 0.0.0.0:8000 &
```
Run gradio webui
```bash