github/DB-GPT
1
0
Fork 0
mirror of https://github.com/csunny/DB-GPT.git synced 2025-07-23 12:21:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,927 Commits 32 Branches 49 Tags 736 MiB
feat/sprint-flow-web-0.6
Commit Graph

256 Commits

Author SHA1 Message Date
chenluli
28c67efbea
fix(web): fix inconsistency between model recommendation charts and display charts (#1615) 
Co-authored-by: hzh97 <2976151305@qq.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-06-13 19:33:36 +08:00
Aries-ckt
57f7b6d64c
chore:v0.5.8 tag (#1632) 2024-06-13 17:53:46 +08:00
明天
0541d1494c
feat(datasource):add oceanbase support (#1622) 
Co-authored-by: csunny <cfqsunny@163.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-06-13 15:13:50 +08:00
Aries-ckt
58d08780d6
feat(ChatKnowledge): ChatKnowledge Support Keyword Retrieve (#1624) 
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-06-13 13:49:17 +08:00
Fangyin Cheng
162e2c9b1c
chore(model): Update the default model to glm-4-9b-chat (#1629) 2024-06-13 09:43:34 +08:00
Fangyin Cheng
e11087aa7e
feat(model): Support Qwen2 models (#1612) 2024-06-07 00:56:20 +08:00
Kevin.Shin
20e7ccc831
FIX:1598 Use PageTextSplitter for DatasourceKnowledge (#1599) 
Co-authored-by: shenk-b <shenk-b@glodon.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-06-06 13:45:50 +08:00
Fangyin Cheng
acd76bada9
feat(model): Support glm-4-9b-chat (#1602) 2024-06-05 15:34:00 +08:00
Fangyin Cheng
43b5821ce4
fix(model): Fix vllm new tokenizer error (#1601) 2024-06-05 15:27:58 +08:00
yyhhyy
c3c063683c
feat(model): Support new zhipuai SDK (#1592) 
Co-authored-by: yyhhyy <yyhhyyyyyy@qq.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-06-04 19:04:52 +08:00
Cooper
04703f2b3a
fix(storage): Fix storage connector error (#1547) 
Co-authored-by: dong <dongzhancai@iie2.com>
Co-authored-by: Zhancai Dong <dongzhancai1@jd.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-05-30 22:02:18 +08:00
Fangyin Cheng
a88af6f87d
feat: Support intent detection (#1588) 2024-05-30 18:51:57 +08:00
Aries-ckt
73d175a127
style:fmt and v0.5.7 tag (#1584) 2024-05-30 15:56:29 +08:00
yongzheJIN
14e159fa67
Update data_loader.py - timestamp+id (#1572) 2024-05-30 10:28:09 +08:00
Aries-ckt
47b0630e88
feat(RAG): add BM25 Retriever. (#1578) 2024-05-30 10:13:24 +08:00
Aries-ckt
8533b3d390
fix:cannot connect other vector store (#1579) 2024-05-30 09:51:15 +08:00
Fangyin Cheng
e481a0acd9
feat(model): Support openchat-3.6-8b-20240522 (#1564) 2024-05-27 22:28:50 +08:00
Fangyin Cheng
82ed4611a5
feat(model): Support llama-3-sqlcoder-8b (#1559) 2024-05-25 17:26:04 +08:00
Aries-ckt
83d7e9d82d
fix(ChatKnowledge): add aload_document (#1548) 2024-05-23 11:59:34 +08:00
Fangyin Cheng
7f55aa4b6e
feat(model): Support Phi-3 models (#1554) 2024-05-23 09:45:32 +08:00
Fangyin Cheng
47430f2a0b
fix(agent): Remove resources of planner agent (#1540) 2024-05-22 15:38:49 +08:00
Cooper
04af30e3db
Fix CrossEncoderRanker (#1531) 
Co-authored-by: dong <dongzhancai@iie2.com>
Co-authored-by: Zhancai Dong <dongzhancai1@jd.com>
 2024-05-20 21:17:06 +08:00
DQ
dcb1bd35d0
fix: wrong default value of parameter parallel_executions for async_retry (#1545) 2024-05-20 19:48:19 +08:00
yongzheJIN
d9a60f9628
Fix data dashboard - data_loader.py (#1526) 2024-05-20 19:42:39 +08:00
Fangyin Cheng
140d1ceafb
feat(model): Support Yi 1.5 16k models (#1543) 2024-05-20 14:32:57 +08:00
Fangyin Cheng
d81bbec4e9
feat(model): Support DeepSeek v2 lite model (#1537) 2024-05-20 10:46:38 +08:00
DQ
8d8411fcd3
feat: Add support for Vertica analytical database (#1538) 2024-05-20 09:45:40 +08:00
Aries-ckt
6fb3d33bf4
fix: delete datasource bug (#1533) 2024-05-17 10:33:30 +08:00
Aries-ckt
c500fb9060
fix:multi client error (#1532) 2024-05-16 23:23:24 +08:00
Aries-ckt
af700d1dc0
fix: Fix web build error (#1530) 2024-05-16 20:26:22 +08:00
Fangyin Cheng
7138ec5166
feat: Support resource for dbgpts (#1527) 2024-05-16 17:19:13 +08:00
tonyzhu
a7d62eaeb5
[Feature] ChatKnowledge Support Excel Document (#1524) 
Co-authored-by: 无剑 <zhuzhenchao@changeme.com>
 2024-05-16 16:23:51 +08:00
Florian
a9087c3853
feat: add GraphRAG framework and integrate TuGraph (#1506) 
Co-authored-by: KingSkyLi <15566300566@163.com>
Co-authored-by: aries_ckt <916701291@qq.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-05-16 15:39:50 +08:00
Fangyin Cheng
593e974405
feat(model): Support deploy rerank model (#1522) 2024-05-16 14:50:16 +08:00
Fangyin Cheng
559affe87d
refactor(agent): Refactor resource of agents (#1518) 2024-05-15 09:57:19 +08:00
IamWWT
db4d318a5f
feat: ES VectorStore (#1500) 
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-05-14 19:55:34 +08:00
付
8b88f7e11c
Fix the issue where the knowledge base cannot be edited when using ve… (#1519) 2024-05-14 19:31:14 +08:00
Fangyin Cheng
81fb56a67c
feat(model): Support Yi-1.5 models (#1516) 2024-05-13 13:50:21 +08:00
Aries-ckt
c8fb508fe4
style: code format (#1513) 2024-05-13 09:39:15 +08:00
Aries-ckt
f389a0c32d
doc:ollama document (#1512) 2024-05-11 17:13:25 +08:00
Aries-ckt
d3131552d3
feat:chroma store refactor (#1508) 2024-05-11 16:31:34 +08:00
Fangyin Cheng
bc9ce3c2ae
fix: Upgrade spacy model (#1511) 2024-05-11 15:41:06 +08:00
ivanzhu
8eb64d7311
fix(rag): Fix CrossEncoderRanker bug of EmbeddingRetriever (#1504) 
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-05-10 13:32:58 +08:00
Cooper
87a67cce7d
fix(rag): Fix rerank bug of EmbeddingRetriever (#1499) 
Co-authored-by: dong <dongzhancai@iie2.com>
 2024-05-09 11:30:50 +08:00
Fangyin Cheng
b38305b72b
feat(model): Support DeepSeek proxy LLM (#1491) 2024-05-07 17:40:16 +08:00
Fangyin Cheng
863b5404dd
refactor(agent): Agent modular refactoring (#1487) 2024-05-07 09:45:26 +08:00
Fangyin Cheng
8427fef5f3
fix: Fix app pydantic error (#1478) 2024-04-29 20:31:02 +08:00
JSDu
939b67715c
fix/milvus will autoflush, manual flush is slowly (#1470) 2024-04-28 22:55:43 +08:00
GITHUBear
744b3e4933
feat(model): support ollama as an optional llm & embedding proxy (#1475) 
Signed-off-by: shanhaikang.shk <shanhaikang.shk@oceanbase.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-04-28 18:36:45 +08:00
yyhhyy
0f8188b152
feat(model): Qwen110B (#1474) 
Co-authored-by: yyhhyy <yyhhyyyyyy@qq.com>
 2024-04-28 14:05:06 +08:00
Aries-ckt
d31491ebb0
chore:v0.5.5 tag (#1468) 2024-04-26 10:55:28 +08:00
付
26eb2000bf
fix: Fix parameter type mismatch issue when using Milvus (#1449) 2024-04-26 09:54:36 +08:00
lipengfei
a5666b3120
feat: Added support for TuGraph graph database (#1451) 
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-04-26 09:48:40 +08:00
GITHUBear
98ebfdcd7a
fix: Fix oceanbase vector_name_exists bug (#1465) 
Signed-off-by: shanhaikang.shk <shanhaikang.shk@oceanbase.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-04-25 18:09:22 +08:00
Aries-ckt
71529975d8
feat(RAG):add MRR and HitRate retriever metrics. (#1456) 2024-04-25 09:12:45 +08:00
GITHUBear
6520367623
support oceanbase as an optional vector database (#1435) 
Signed-off-by: shanhaikang.shk <shanhaikang.shk@oceanbase.com>
 2024-04-24 16:08:30 +08:00
Aries-ckt
91c1371234
feat(RAG):add cross-encoder rerank (#1442) 
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-04-24 14:12:44 +08:00
yyhhyy
dce03862d5
feat(model): Support Qwen2MoE (#1439) 
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-04-20 21:03:10 +08:00
Fangyin Cheng
82e4ce4c43
feat(model): Support Llama-3 (#1436) 2024-04-20 14:07:09 +08:00
Aries-ckt
b49b07f011
feat[Datasource]:add summary refresh (#1433) 
Co-authored-by: hzh97 <2976151305@qq.com>
 2024-04-20 10:04:12 +08:00
Fangyin Cheng
57be1ece18
feat(core): Upgrade pydantic to 2.x (#1428) 2024-04-20 09:41:16 +08:00
dusens
baa1e3f9f6
fix:[chatdb] clickhouse occur error AttributeError: 'ClickhouseConnect… (#1432) 2024-04-18 23:46:08 +08:00
yyhhyy
00af9fed35
fix(awel): Fix awel check for empty DataFrame data bug (#1430) 2024-04-18 15:15:07 +08:00
yyhhyy
8625690107
feat(model): Support CodeQwen1.5-7B-Chat (#1431) 2024-04-18 15:14:14 +08:00
Fangyin Cheng
461607e421
feat: Support retry for 'Chat Data' (#1419) 2024-04-16 00:03:18 +08:00
Fangyin Cheng
2e2e120ace
feat(agent): dbgpts support agent (#1417) 2024-04-14 23:32:01 +08:00
yyhhyy
f3ece627d0
fix rdbms_db_summary (#1409) 2024-04-13 11:03:49 +08:00
katakuri
583009305a
fix(web): [chat_dashboard]Editor always run the first sql (#1413) 2024-04-12 14:26:31 +08:00
Fangyin Cheng
c3ae1915d2
refactor: Modify default webserver port to 5670 (#1410) 2024-04-12 11:47:24 +08:00
Fangyin Cheng
aea575e0b4
feat(agent): Add trace for agent (#1407) 2024-04-11 19:07:06 +08:00
Fangyin Cheng
7d6dfd9ea8
feat(model): Support moonshot proxy LLM (#1404) 2024-04-10 23:41:50 +08:00
Aries-ckt
1c6a897137
chore:v0.5.4 version and update wechat (#1403) 2024-04-10 23:07:00 +08:00
lcxadml
d55c51a6b7
Feat: optimize dashboard UI and fix sql highlight (#1329) 
Co-authored-by: hzh97 <2976151305@qq.com>
Co-authored-by: aries_ckt <916701291@qq.com>
 2024-04-10 22:50:47 +08:00
Fangyin Cheng
df80bc2079
feat(agent): Release agent SDK (#1396) 2024-04-10 22:44:53 +08:00
Aries-ckt
37e7c0151b
feat(RAG):add metadata properties filters (#1395) 2024-04-10 14:33:24 +08:00
yyhhyy
0f2b46da62
fix: Code standards (#1393) 2024-04-09 21:01:32 +08:00
Evan Chen
01a8a0fff6
Solve the problem of resource duplication and solve the problem of slow recall of table structure (#1381) 
Co-authored-by: ChenXinye <chenxinye@weihaizixun.com>
 2024-04-08 19:57:51 +08:00
Fangyin Cheng
634e62cb6e
feat: Support HTTP sender (#1383) 2024-04-08 16:13:49 +08:00
Fangyin Cheng
df36b947d1
feat(model): Support Qwen1.5-32B (#1385) 2024-04-08 09:40:24 +08:00
Aries-ckt
d4da50330f
fix: dashboard editor run error (#1380) 2024-04-07 15:04:28 +08:00
yyhhyy
f2a6284c0e
fix: Fix the mypy check error (#1373) 
Co-authored-by: yyhhyy <95077259+Hui824@users.noreply.github.com>
Co-authored-by: aries_ckt <916701291@qq.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
 2024-04-07 14:22:23 +08:00
xiuzhu9527
6210b73ba2
fix: when delete knowledge, error: space list error embedding is required for MilvusStore (#1359) 
Co-authored-by: xiuzhu <edy@dodge-pro.local>
 2024-04-02 11:09:27 +08:00
付
4238a670bf
fix: Fix the issue of invalid port settings (#1351) 2024-03-29 17:25:42 +08:00
Fangyin Cheng
a272d1b8f3
feat(model): Support Starling-LM-7B-beta (#1350) 2024-03-29 17:25:30 +08:00
Aries-ckt
e0ab852a60
chore:version and wechat update (#1346) 2024-03-28 15:05:36 +08:00
Aries-ckt
dffd235bfb
feat: Client support chatdata (#1343) 2024-03-28 09:04:28 +08:00
Fangyin Cheng
f144fc3d36
docs: Add AWEL chat data cookbook (#1345) 2024-03-27 22:47:28 +08:00
Fangyin Cheng
3a7a2cbbb8
feat: Run AWEL flow in CLI (#1341) 2024-03-27 12:50:05 +08:00
Fangyin Cheng
fcc325d411
feat(core): Support i18n (#1327) 2024-03-25 20:15:39 +08:00
Fangyin Cheng
8a17099dd2
feat(rag): Support RAG SDK (#1322) 2024-03-22 15:36:57 +08:00
明天
e65732d6e4
feat: add Client and API v2 (#1316) 
# Description
1. Provide /api/v2 for DB-GPT
2.  Add DBGPT Python Client for Chat, Flow, App, Knowledge, Including:
   - Chat
   - Create
   - Update
   - Delete
   - Get
   - List
 3. Add examples in `examples/client/`
 4. Add API Reference document

# How Has This Been Tested?
## Test Chat Normal
### Curl
1. set `API_KEYS=dbgpt` in `.env`
2. `python dbgpt/app/dbgpt_server.py`
3. test with curl 
```
DBGPT_API_KEY=dbgpt
curl -X POST "http://localhost:5000/api/v2/chat/completions" \
    -H "Authorization: Bearer $DBGPT_API_KEY" \
    -H "accept: application/json" \
    -H "Content-Type: application/json" \
    -d "{\"messages\":\"Hello\",\"model\":\"chatgpt_proxyllm\"}"
```

```
data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": "Hello"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": "!"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " How"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " can"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " I"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " assist"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " you"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": " today"}}]}

data: {"id": "chatcmpl-ab5fd180-e699-11ee-8388-acde48001122", "model": "chatgpt_proxyllm", "choices": [{"index": 0, "delta": {"role": "assistant", "content": "?"}}]}

data: [DONE]
```

### Python
```python
from dbgpt.client import Client

DBGPT_API_KEY = "dbgpt"
client = Client(api_key=DBGPT_API_KEY)
# stream
async for data in client.chat_stream(
    model="chatgpt_proxyllm",
    messages="hello",
):
   print(data)

# no stream
await client.chat(model="chatgpt_proxyllm", messages="hello")

```
## Test Chat App
### Curl
 test with curl 
```
 DBGPT_API_KEY=dbgpt
 APP_CODE={YOUR_APP_CODE}

curl -X POST "http://localhost:5000/api/v2/chat/completions" \
    -H "Authorization: Bearer $DBGPT_API_KEY" \
    -H "accept: application/json" \
    -H "Content-Type: application/json" \
    -d "{\"messages\":\"Hello\",\"model\":\"chatgpt_proxyllm\", \"chat_mode\": \"chat_app\", \"chat_param\": \"$APP_CODE\"}"

```
### Python
```python
from dbgpt.client import Client

DBGPT_API_KEY = "dbgpt"
client = Client(api_key=DBGPT_API_KEY)
APP_CODE="{YOUR_APP_CODE}"

async for data in client.chat_stream(
     model="chatgpt_proxyllm",
     messages="hello",
     chat_mode="chat_app", 
     chat_param=APP_CODE
    ):
        print(data)

```


# Snapshots:

Include snapshots for easier review.

# Checklist:

- [x] My code follows the style guidelines of this project
- [x] I have already rebased the commits and make the commit message
conform to the project standard.
- [x] I have performed a self-review of my own code
- [x] I have commented my code, particularly in hard-to-understand areas
- [x] I have made corresponding changes to the documentation
- [x] Any dependent changes have been merged and published in downstream
modules
 2024-03-22 09:57:58 +08:00
Hzh_97
04322de4f3
fix(web): Fix sql format error (#1319) 2024-03-21 17:41:25 +08:00
aries_ckt
f117f4d297 fix:api_v1 msg error 2024-03-21 16:12:48 +08:00
aries_ckt
ab9d8a370e fix:return conv_uid and update wechat 2024-03-21 15:59:46 +08:00
aries_ckt
0cf08f37b0 fix:update app schemas. 2024-03-21 15:30:57 +08:00
aries_ckt
a1369c02c4 fix:client path error and update chat_knowledge prompt 2024-03-21 14:13:59 +08:00
Fangyin Cheng
b4b810d68f feat(core): Add common schemas 2024-03-21 11:23:24 +08:00
Fangyin Cheng
ab3e8e54a1 feat(client): Modify api address 2024-03-21 09:58:32 +08:00
aries_ckt
75f086a41d doc:update api docs 2024-03-20 18:40:59 +08:00
aries_ckt
f43abf3155 fix:client mypy error 2024-03-20 16:22:38 +08:00