github/DB-GPT
1
0
Fork 0
mirror of https://github.com/csunny/DB-GPT.git synced 2025-09-02 17:45:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

llm proxy framework design, adding support for bard large language model proxy (#376)

Browse Source 
1. llm proxy framework design, adding support for bard large language
model proxy
2. add Alibaba Cloud Image Deployment Solution.

Close #369
This commit is contained in:
magic.chen
2023-07-28 17:04:09 +08:00
committed by GitHub
parent bd93f28812 4da524340c
commit 9236f4260e
20 changed files with 200 additions and 64 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/modules/llms.md
View File

@@ -126,3 +126,11 @@ MODEL_SERVER=127.0.0.1:8000
PROXY_API_KEY=sk-xxx
PROXY_SERVER_URL={your-openai-proxy-server/v1/chat/completions}
```
### 2. Bard Proxy
- If your environment deploying DB-GPT has access to https://bard.google.com/ (F12-> application-> __Secure-1PSID), then modify the .env configuration file as below will work.
```
LLM_MODEL=bard_proxyllm
MODEL_SERVER=127.0.0.1:8000
BARD_PROXY_API_KEY={your-bard-key}
```