Commit Graph

1293 Commits

Author SHA1 Message Date
aries_ckt
d201ea2949 style:fmt 2023-08-22 16:25:45 +08:00
FangYin Cheng
3f6e9687ee feat: Support windows
fix: Fix install error on linux

doc: Add torch cuda FAQ
2023-08-22 14:35:11 +08:00
yhjun1026
7e22d0d1b7 feat(editor): ChatExcel
ChatExcel devlop part 3
2023-08-22 13:55:02 +08:00
aries_ckt
5ed35acce8 feat:add clickouse connection 2023-08-22 13:25:23 +08:00
yhjun1026
5bbe47d715 feat(editor): ChatExcel
ChatExcel devlop part 2
2023-08-21 19:18:10 +08:00
aries_ckt
2ae2e3c4a7 Merge remote-tracking branch 'origin/main' into dbgpt_api 2023-08-18 17:58:42 +08:00
FangYin Cheng
efd17593ce fix: Fix alpaca prompt error 2023-08-18 17:18:01 +08:00
FangYin Cheng
909bb263a4 feat: Add examples and modify deploy documents 2023-08-18 15:12:37 +08:00
aries_ckt
0ff6fc880d doc:faq and kbqa document 2023-08-18 15:07:01 +08:00
aries_ckt
70a091364f fix:add sqlite db type 2023-08-18 11:28:27 +08:00
yhjun1026
29be096a96 Merge branch 'main' into TY_08_DEV_NEW
# Conflicts:
#	requirements.txt
2023-08-18 10:44:36 +08:00
yhjun1026
1bed2644fa feat(editor): ChatExcel
ChatExcel devlop part 1
2023-08-18 10:43:36 +08:00
yhjun1026
76745d0e57 feat(editor): ChatExcel
ChatExcel devlop part 1
2023-08-18 10:13:55 +08:00
aries_ckt
281ea7cee6 doc:faq and llama.cpp llm usage 2023-08-17 21:53:35 +08:00
aries_ckt
7057d8943c chore:merge branch main 2023-08-17 20:45:35 +08:00
aries_ckt
63af66ccc1 doc:refactor install document and application document 2023-08-16 23:20:08 +08:00
FangYin Cheng
303efb9d4e feat: Split some main dependencies into optional dependencies 2023-08-16 04:26:05 +08:00
FangYin Cheng
e5b03c8ab4 fix: fix issue #445, sqlite unable to open database file 2023-08-16 04:25:53 +08:00
FangYin Cheng
b5fd5d2a3a feat: Support llama.cpp 2023-08-15 19:00:08 +08:00
yhjun1026
382d2f3831 Merge branch 'main' into TY_08_DEV_NEW
# Conflicts:
#	README.md
#	pilot/connections/rdbms/base.py
#	pilot/server/static/404.html
#	pilot/server/static/404/index.html
#	pilot/server/static/chat/index.html
#	pilot/server/static/chat/index.txt
#	pilot/server/static/datastores/documents/chunklist/index.html
#	pilot/server/static/datastores/documents/chunklist/index.txt
#	pilot/server/static/datastores/documents/index.html
#	pilot/server/static/datastores/documents/index.txt
#	pilot/server/static/datastores/index.html
#	pilot/server/static/datastores/index.txt
#	pilot/server/static/index.html
#	pilot/server/static/index.txt
2023-08-15 16:27:27 +08:00
yhjun1026
44225e9aea feat(editor): ChatExcel
ChatExcel devlop part 1
2023-08-15 16:24:09 +08:00
yhjun1026
0bd99d7764 feat(editor): editor api devlop
editor api devlop part 2
2023-08-14 15:30:02 +08:00
yhjun1026
1f881dca25 feat(editor): editor api devlop
editor api devlop part 2
2023-08-14 15:23:08 +08:00
FangYin Cheng
8cea0b9a9f feat: Knowledge QA support SQLite 2023-08-11 18:25:03 +08:00
FangYin Cheng
0859f36a89 feat: Support SQLite connection 2023-08-11 18:25:03 +08:00
aries_ckt
f1fe45cbe1 fix:web-page upload file 405 2023-08-11 15:54:57 +08:00
yhjun1026
f6fb9c04d3 feat(editor): editor api devlop
editor api devlop part 2
2023-08-11 14:38:27 +08:00
aries_ckt
e6b97de551 style:fmt 2023-08-10 19:33:10 +08:00
aries_ckt
4a3dbd8ff6 style:fmt 2023-08-10 19:27:52 +08:00
aries_ckt
33397f9583 fix:knowledge arguments prompt override 2023-08-10 15:53:30 +08:00
yhjun1026
a95d292bf9 feat(editor): editor api devlop
editor api devlop part 1
2023-08-10 15:01:00 +08:00
aries_ckt
a7ec3400fe style:fmt 2023-08-10 14:38:50 +08:00
aries_ckt
84fbebda4c feat:add knowledge argument web page 2023-08-10 10:39:52 +08:00
aries_ckt
251f314c92 feat:add knowledge argument web page 2023-08-07 16:57:31 +08:00
aries_ckt
aa3c3205a4 feat:add knowledge space argument 2023-08-07 16:36:41 +08:00
magic.chen
c4758a6fae
fix: document delete bug (#408)
1.document delete bug
2.readme assets
2023-08-03 19:54:26 +08:00
aries_ckt
ba55fcf596 fix: document delete bug
1.document delete bug
2.readme assets
2023-08-03 18:14:21 +08:00
csunny
743863d52b fix: set num_gpus reference for mps + cpu 2023-08-03 16:54:58 +08:00
csunny
d67a6a642a fix: num_gpus referenced error for mps + cpu 2023-08-03 16:52:39 +08:00
magic.chen
221aa6eb22
feat:knowledge space and document delete (#403)
1.add knowledge space delete and document delete
2.knowledge chat route
3.docs, readme, star history
4.fix csv loader bug, add new csv_loader
Close #396
2023-08-03 16:13:00 +08:00
aries_ckt
dfa31a39c6 style: fmt 2023-08-03 15:39:16 +08:00
aries_ckt
7dad8b0b31 feat:static web file 2023-08-03 14:30:18 +08:00
FangYin Cheng
a4574aa614 feat: Support vicuna-v1.5 and WizardLM-v1.2 2023-08-03 14:14:29 +08:00
aries_ckt
986fadef88 fix:merge main branch 2023-08-03 14:07:54 +08:00
aries_ckt
d6a23ead3b fix:csv_loader bug
1.add new_csv_loader,override load()
2.add loader dir
Close #396
2023-08-03 13:02:26 +08:00
FangYin Cheng
bceb609cf6 feat: Modify config for quantization and doc 2023-08-02 19:29:59 +08:00
FangYin Cheng
d8a4b776d5 feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference 2023-08-02 19:29:59 +08:00
yhjun1026
18f2532f76 fix(web): Switching from the dashboard page to other dialogue record pages reports an error 2023-08-02 16:41:15 +08:00
yhjun1026
de3bcd1f68 fix(readme): discord id change
discord id change
2023-08-02 16:38:29 +08:00
aries_ckt
f270283091 chore: rename vector_store_base to base 2023-08-01 20:08:58 +08:00
yhjun1026
c689a63a73 feat(editor):editor api 2023-08-01 19:45:15 +08:00
yhjun1026
c519203cd6 feat(db-g[t): black param change 2023-08-01 18:11:59 +08:00
yhjun1026
cc05400093 feat(editor): DB GPT Editor Api
1.Add DB GPT Editor Api
2.Remove Old web server file
2023-08-01 18:00:03 +08:00
yhjun1026
e340e8daff Merge branch 'TY_07_DEV' into TY_08_END 2023-08-01 15:53:26 +08:00
yhjun1026
77f6b2f458 feat:Db summary merge multi db connect 2023-08-01 15:35:59 +08:00
yhjun1026
40659b93e7 feat:Db connect setting on web 2023-08-01 14:14:10 +08:00
aries_ckt
ce28ef5ce6 fix:knowledge document update bug 2023-08-01 14:00:48 +08:00
aries_ckt
f6359196b2 feat:knowledge document link to chat 2023-08-01 11:08:59 +08:00
xuyuan23
dea677004a fix: simply the code and optimization
simply the code and optimization
2023-07-31 19:19:39 +08:00
xuyuan23
1ff4cfdc42 feat: support bard proxy server
support bard proxy server

Close #384
2023-07-31 17:49:10 +08:00
aries_ckt
7186309f83 feat:knowledge document delete
1.space delete
2.document delete
2023-07-31 16:47:48 +08:00
csunny
1da65255cd chores: clean code + discord update 2023-07-29 19:55:23 +08:00
magic.chen
9236f4260e
llm proxy framework design, adding support for bard large language model proxy (#376)
1. llm proxy framework design, adding support for bard large language
model proxy
2. add Alibaba Cloud Image Deployment Solution.

Close #369
2023-07-28 17:04:09 +08:00
xuyuan23
4da524340c refactor: rename the data privacy module
rename data privace module.
2023-07-28 14:45:27 +08:00
FangYin Cheng
4c738af378 fix: fix issue #367, ModelMessage is not JSON serializabl 2023-07-28 04:36:16 +08:00
xuyuan23
ca50e87b8f fix: support bard in chatdb
support bard proxy llm  in chatdb
2023-07-27 19:22:23 +08:00
yhjun1026
0ed51b5ee4 Merge branch 'main' into TY_07_DEV 2023-07-27 17:57:49 +08:00
yhjun1026
1547c3aff1 DDL run bug fix 2023-07-27 17:57:18 +08:00
yhjun1026
0b33943dd9 Merge remote-tracking branch 'origin/main' into TY_07_DEV 2023-07-27 17:56:55 +08:00
xuyuan23
c4638bfde3 fix: fix function bard_generate_stream's output
fix function bard_generate_stream's output
2023-07-27 11:11:59 +08:00
xuyuan23
572c336b81 feat: Adjusting the proxy framework.
Adjusting the proxy framework, chatgpt_proxyllm default, or proxyllm instead, new LLM proxy should be configured in format 'xxx_proxyllm'.
2023-07-27 11:03:29 +08:00
csunny
2d5226ab21 feat: add logo for db-gpt 2023-07-26 19:59:30 +08:00
xuyuan23
b1d84fb317 fix: fix bard LLM request param error
fix bard LLM request param error, use 'content' as the input
2023-07-26 17:02:48 +08:00
xuyuan23
d95726c04a feat: add Bard LLM proxy
Supplement proxy framework content, adding proxy access method for the Bard LLM.

Closes #369
2023-07-26 16:36:26 +08:00
FangYin Cheng
4b1c0a36f8 feat: Support baichuan-7B model 2023-07-25 22:08:07 +08:00
FangYin Cheng
7baaaf0849 feat: Support baichuan-13B model 2023-07-25 22:07:02 +08:00
FangYin Cheng
35d0c17ae8 feat: Support baichuan-7B model 2023-07-25 19:48:21 +08:00
FangYin Cheng
01074660bc feat: Support baichuan-13B model 2023-07-25 19:48:21 +08:00
magic.chen
7cc86a8b54
<fix>DML and DDL run bug fix (#364)
1.DDL run result query bug fix
2.DML code function change bug fix
2023-07-25 19:31:15 +08:00
yhjun1026
657484608e Merge remote-tracking branch 'origin/test' into test 2023-07-25 19:00:36 +08:00
yhjun1026
dab39a1180 DDL run bug fix 2023-07-25 19:00:03 +08:00
aries_ckt
795be61d4a style:fmt 2023-07-25 17:22:11 +08:00
aries_ckt
487f91a1ec feat:docxLoader and ppt_loader 2023-07-25 15:21:53 +08:00
aries_ckt
48fc8c47ac fix:web-ui bug
1.webuibug
2.requirememt update
2023-07-25 11:26:20 +08:00
aries_ckt
88d5fed5b8 Merge remote-tracking branch 'origin/main' into dbgpt_api 2023-07-25 10:15:21 +08:00
magic.chen
7233b9711f
Fixed the issue when the MySQL table name had the keyword in it (#358)
When a table name with special characters, such as trigger, exists in
the database, the following error is reported.
```log
2023-07-25 00:02:47 | ERROR | stderr | sqlalchemy.exc.ProgrammingError: (pymysql.err.ProgrammingError) (1064, "You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'trigger' at line 1")
2023-07-25 00:02:47 | ERROR | stderr | [SQL: SHOW INDEXES FROM trigger]
```
2023-07-25 00:23:47 +08:00
yiqijiu
34aa73fa76 Fixed the issue when the MySQL table name had the keyword in it 2023-07-24 15:59:25 +00:00
csunny
cc5564af23 chroes: fix + lint 2023-07-24 19:27:24 +08:00
csunny
51df0ee022 fix: update + filter meta db. 2023-07-24 19:25:13 +08:00
csunny
632aee3149 lint: fix pylint 2023-07-24 18:55:57 +08:00
aries_ckt
45fbcafbf6 fix:word embedding update
1.use Docx2txtLoader replace UnstructuredWordDocumentLoader
2023-07-24 17:37:21 +08:00
yhjun1026
ea97bfccc7 web bug fix 2023-07-24 17:13:27 +08:00
yhjun1026
94fb112979 web bug fix 2023-07-24 16:19:19 +08:00
yhjun1026
9ac402e55a web bug fix 2023-07-24 16:02:46 +08:00
yhjun1026
c973c9e644 Merge branch 'main' into test
# Conflicts:
#	pilot/scene/chat_dashboard/prompt.py
2023-07-24 15:59:09 +08:00
yhjun1026
02bf99c86a web bug fix 2023-07-24 15:57:50 +08:00
yhjun1026
bb30035a2a web bug fix 2023-07-24 15:42:41 +08:00
yhjun1026
6d223b9072 web bug fix 2023-07-24 15:07:15 +08:00
yhjun1026
439d23c29c 代码清理 2023-07-24 14:53:34 +08:00
yhjun1026
6e505860be 代码清理 2023-07-24 14:32:50 +08:00
yhjun1026
cbd22a4b88 代码清理 2023-07-24 13:57:10 +08:00
yhjun1026
602c0b7361 代码清理 2023-07-21 20:57:17 +08:00
FangYin Cheng
f234b30f7a feat: Multi-model prompt adaptation 2023-07-21 20:51:53 +08:00
yhjun1026
c8c4a82578 代码清理 2023-07-21 20:06:54 +08:00
yhjun1026
b9d64d9ff3 代码清理 2023-07-21 20:06:32 +08:00
yhjun1026
3f733a302b 代码清理 2023-07-21 18:21:39 +08:00
yhjun1026
ad4fd6c0fe Merge branch 'main' into dev_ty_06_end
# Conflicts:
#	pilot/common/schema.py
#	pilot/common/sql_database.py
#	pilot/connections/rdbms/duckdb.py
#	pilot/connections/rdbms/mssql.py
#	pilot/connections/rdbms/oracle.py
#	pilot/connections/rdbms/rdbms_connect.py
#	pilot/openapi/api_v1/api_v1.py
#	pilot/scene/base.py
#	pilot/scene/chat_dashboard/chat.py
#	pilot/scene/chat_dashboard/data_preparation/report_schma.py
#	pilot/scene/chat_dashboard/prompt.py
#	pilot/scene/chat_dashboard/template/sales_report/dashboard.json
#	pilot/server/static/404.html
#	pilot/server/static/404/index.html
#	pilot/server/static/chat/index.html
#	pilot/server/static/chat/index.txt
#	pilot/server/static/datastores/documents/chunklist/index.html
#	pilot/server/static/datastores/documents/chunklist/index.txt
#	pilot/server/static/datastores/documents/index.html
#	pilot/server/static/datastores/documents/index.txt
#	pilot/server/static/datastores/index.html
#	pilot/server/static/datastores/index.txt
#	pilot/server/static/index.html
#	pilot/server/static/index.txt
#	pilot/server/webserver.py
#	pilot/server/webserver_base.py
#	pilot/xx.db
#	requirements.txt
2023-07-21 18:21:02 +08:00
yhjun1026
8452077f05 Multi DB support 2023-07-21 17:33:37 +08:00
yhjun1026
88be492144 Multi DB support 2023-07-21 17:26:56 +08:00
yhjun1026
760e8ed5a3 Multi DB support 2023-07-21 17:25:16 +08:00
yhjun1026
23dadef155 Multi DB support 2023-07-21 17:21:51 +08:00
yhjun1026
35536df73e Merge branch 'main' into dev_ty_06_end
# Conflicts:
#	pilot/common/sql_database.py
#	pilot/configs/config.py
#	pilot/scene/base.py
#	pilot/scene/chat_dashboard/chat.py
#	pilot/scene/chat_dashboard/data_preparation/report_schma.py
#	pilot/scene/chat_dashboard/prompt.py
2023-07-21 16:46:59 +08:00
yhjun1026
a8af407ddf Multi DB support 2023-07-21 16:39:51 +08:00
yhjun1026
288e55a97f Multi DB support 2023-07-21 10:15:32 +08:00
FangYin Cheng
168c754a3f feat: Support llama-2 model 2023-07-20 21:44:40 +08:00
FangYin Cheng
ef2f7999a5 feat: Support llama-2 model 2023-07-20 21:44:40 +08:00
FangYin Cheng
80f1a99b4d feat: add warning message when using generate_llm_text 2023-07-19 12:17:01 +08:00
FangYin Cheng
b03f3efe97 feat: add warning message when using generate_llm_text 2023-07-19 12:17:01 +08:00
FangYin Cheng
d805e6ab42 feat: structured prompt data interaction between dbgpt-server and llm-server 2023-07-19 12:10:22 +08:00
FangYin Cheng
ae761a3bfa feat: structured prompt data interaction between dbgpt-server and llm-server 2023-07-19 12:10:22 +08:00
magic.chen
75115f1175
feat:dbgpt api 0.3.0 (#319)
1.EmbeddingEngine:provide knowledge_embedding() and similar_search()
2.Multi SourceEmbedding
3.doc for installation
4.fix chroma exit bug
2023-07-14 13:47:06 +08:00
magic.chen
5e2f1e563f feat:dbgpt api 0.3.0 (#319)
1.EmbeddingEngine:provide knowledge_embedding() and similar_search()
2.Multi SourceEmbedding
3.doc for installation
4.fix chroma exit bug
2023-07-14 13:47:06 +08:00
aries_ckt
442c0a9690 fix:auto execute example selector:None 2023-07-14 11:29:39 +08:00
aries_ckt
4fbb6fc3e1 fix:auto execute example selector:None 2023-07-14 11:29:39 +08:00
aries_ckt
109ef7eb0f fix:embedding_api 2023-07-13 22:14:25 +08:00
aries_ckt
4bd55cd34d fix:embedding_api 2023-07-13 22:14:25 +08:00
aries_ckt
b5f3e079db docs:v0.3.1 docs
1.fmt
2.docs
2023-07-13 19:23:03 +08:00
aries_ckt
e01308d9be docs:v0.3.1 docs
1.fmt
2.docs
2023-07-13 19:23:03 +08:00
FangYin Cheng
accce56d49 fix pylint 2023-07-13 18:11:41 +08:00
FangYin Cheng
67f69e0565 fix pylint 2023-07-13 18:11:41 +08:00
FangYin Cheng
189ac995ec fix: chatglm not working in doc qa, meta qa and plugin 2023-07-13 18:03:27 +08:00
FangYin Cheng
9af2890892 fix: chatglm not working in doc qa, meta qa and plugin 2023-07-13 18:03:27 +08:00
aries_ckt
4e33e6ec2e fix:ignore knowledge_management databases 2023-07-13 16:39:02 +08:00
aries_ckt
df0b562bf8 fix:ignore knowledge_management databases 2023-07-13 16:39:02 +08:00
aries_ckt
6404bfe63a feat:embedding api
1.embedding_engine add source_reader param
2.docs update
3.fix chroma exit bug
2023-07-13 15:45:25 +08:00
aries_ckt
03b507a4e9 feat:embedding api
1.embedding_engine add source_reader param
2.docs update
3.fix chroma exit bug
2023-07-13 15:45:25 +08:00
yhjun1026
73b3b7069f WEB API independent 2023-07-13 10:19:33 +08:00
aries_ckt
56c1947eda feat:embedding_engine add text_splitter param 2023-07-12 18:01:22 +08:00
aries_ckt
ff89e2e085 feat:embedding_engine add text_splitter param 2023-07-12 18:01:22 +08:00
aries_ckt
30adbaf4fd doc:update knowledge api document 2023-07-12 16:33:34 +08:00
aries_ckt
f911a8fa97 doc:update knowledge api document 2023-07-12 16:33:34 +08:00
aries_ckt
16d6ce8c89 doc:knowledge docs update 2023-07-12 14:28:40 +08:00
aries_ckt
dd02c5d4ba doc:knowledge docs update 2023-07-12 14:28:40 +08:00
aries_ckt
f85def5a52 Merge remote-tracking branch 'origin/main' into dbgpt_api 2023-07-12 13:54:17 +08:00
aries_ckt
4b66ce7b9c Merge remote-tracking branch 'origin/main' into dbgpt_api 2023-07-12 13:54:17 +08:00
aries_ckt
929e7fe96b refactor:refactor knowledge api
1.delete CFG in embedding_engine api
2.add a text_splitter param in embedding_engine api
3.fmt
2023-07-12 11:07:35 +08:00
aries_ckt
2b68fd7b42 refactor:refactor knowledge api
1.delete CFG in embedding_engine api
2.add a text_splitter param in embedding_engine api
3.fmt
2023-07-12 11:07:35 +08:00
qutcat1997
586ea2a97f
Update adapter.py
change CFG
2023-07-11 23:28:30 +08:00
qutcat1997
20675edca6 Update adapter.py
change CFG
2023-07-11 23:28:30 +08:00
qutcat1997
3730871f5d
Update adapter.py
Solve multi gpu research
2023-07-11 23:17:00 +08:00
qutcat1997
0e6732d4cd Update adapter.py
Solve multi gpu research
2023-07-11 23:17:00 +08:00
qutcat1997
bc08285356
Update config.py
Modify config
2023-07-11 23:06:41 +08:00
qutcat1997
189b0b4eed Update config.py
Modify config
2023-07-11 23:06:41 +08:00
aries_ckt
e6aa46fc87 refactor:refactor knowledge api
1.delete CFG in embedding_engine api
2.add a text_splitter param in embedding_engine api
2023-07-11 16:33:48 +08:00
aries_ckt
a357ab498a refactor:refactor knowledge api
1.delete CFG in embedding_engine api
2.add a text_splitter param in embedding_engine api
2023-07-11 16:33:48 +08:00
aries_ckt
6ff7ef9da4 doc:update knowledge api 2023-07-10 17:00:45 +08:00
aries_ckt
60d6c0d040 doc:update knowledge api 2023-07-10 17:00:45 +08:00
aries_ckt
56b32ab094 refactor:rename knowledge embedding api
1.replace knowledge_embedding of embedding_engine
2023-07-10 15:50:34 +08:00
aries_ckt
312f243382 refactor:rename knowledge embedding api
1.replace knowledge_embedding of embedding_engine
2023-07-10 15:50:34 +08:00
yhjun1026
3638f4848f WEB API independent 2023-07-10 14:34:11 +08:00
FangYin Cheng
23b36872f6 fix: proxy llm raise exception when proxy llm response has error 2023-07-07 17:21:43 +08:00
FangYin Cheng
d1a735f3cc fix: proxy llm raise exception when proxy llm response has error 2023-07-07 17:21:43 +08:00
yhjun1026
36dd616a19 WEB API independent 2023-07-07 16:08:32 +08:00
yhjun1026
28a08a1245 WEB API independent 2023-07-07 16:02:17 +08:00
aries_ckt
b68bb2b5d5 test:delete unusual test file 2023-07-06 19:10:09 +08:00
aries_ckt
48204b54ff test:delete unusual test file 2023-07-06 19:10:09 +08:00
tuyang.yhj
8dc4f54ed6 WEB API independent 2023-07-06 14:09:51 +08:00
aries_ckt
eb31d5523e doc:update dbgpt_demo.mp4
1.update dbgpt_demo.mp4
2.format code
2023-07-06 13:47:46 +08:00
aries_ckt
6dbf5a2097 doc:update dbgpt_demo.mp4
1.update dbgpt_demo.mp4
2.format code
2023-07-06 13:47:46 +08:00
tuyang.yhj
c909ba0b42 Merge remote-tracking branch 'origin/dev_ty_06_end' into dev_ty_06_end 2023-07-06 10:25:34 +08:00
tuyang.yhj
5093e3714a WEB API independent 2023-07-06 10:25:02 +08:00
aries_ckt
469f5007ae refactor: merge dbgpt_test
1.merge dbgpt_test
2.restore weaviate_store.py
2023-07-05 17:10:21 +08:00
aries_ckt
339723f080 refactor: merge dbgpt_test
1.merge dbgpt_test
2.restore weaviate_store.py
2023-07-05 17:10:21 +08:00
aries_ckt
b36718494e fix:chunk use RecursiveCharacterTextSplitter 2023-07-05 15:28:58 +08:00
aries_ckt
e37ecf262e fix:chunk use RecursiveCharacterTextSplitter 2023-07-05 15:28:58 +08:00
aries_ckt
3bc989f9e9 fix:fix webapi 2023-07-05 15:08:00 +08:00
aries_ckt
71f386d0b9 fix:fix webapi 2023-07-05 15:08:00 +08:00
tuyang.yhj
f0ace7912f WEB API independent 2023-07-05 14:24:39 +08:00
tuyang.yhj
8790d89b35 WEB API independent 2023-07-05 14:24:39 +08:00
tuyang.yhj
352ee26235 WEB API independent 2023-07-05 14:22:47 +08:00
tuyang.yhj
876c6cbbf3 WEB API independent 2023-07-05 14:22:47 +08:00
tuyang.yhj
3b99ba59d6 WEB API independent 2023-07-05 14:21:06 +08:00
tuyang.yhj
e457005a9c WEB API independent 2023-07-05 14:21:06 +08:00
tuyang.yhj
d24e480e85 WEB API independent 2023-07-05 14:02:34 +08:00
tuyang.yhj
5b67ae5e3b WEB API independent 2023-07-05 14:02:34 +08:00
tuyang.yhj
6c90740fbe WEB API independent 2023-07-05 11:52:19 +08:00
tuyang.yhj
5c591100ad WEB API independent 2023-07-05 11:52:19 +08:00
tuyang.yhj
4475c0eabe WEB API independent 2023-07-05 11:41:04 +08:00
tuyang.yhj
b564d0cc89 WEB API independent 2023-07-05 11:41:04 +08:00
tuyang.yhj
b02c30b611 Merge remote-tracking branch 'origin/dev_ty_06_end' into dev_ty_06_end 2023-07-05 11:10:26 +08:00
tuyang.yhj
ad6900a578 Merge remote-tracking branch 'origin/dev_ty_06_end' into dev_ty_06_end 2023-07-05 11:10:26 +08:00
tuyang.yhj
f68c74352b WEB API independent 2023-07-05 11:10:14 +08:00
tuyang.yhj
e949c8b66a WEB API independent 2023-07-05 11:10:14 +08:00
aries_ckt
73117ad73f Merge remote-tracking branch 'origin/llm_framework' into dev_ty_06_end 2023-07-04 20:43:38 +08:00
aries_ckt
e57f4427fb Merge remote-tracking branch 'origin/llm_framework' into dev_ty_06_end 2023-07-04 20:43:38 +08:00
tuyang.yhj
dd064a090f WEB API independent 2023-07-04 20:33:41 +08:00
tuyang.yhj
1a067b3909 WEB API independent 2023-07-04 20:33:41 +08:00
tuyang.yhj
7567a0231a WEB API independent 2023-07-04 20:12:03 +08:00
tuyang.yhj
cccc7be9e9 WEB API independent 2023-07-04 20:12:03 +08:00
tuyang.yhj
323aa32fca WEB API independent 2023-07-04 20:09:38 +08:00
tuyang.yhj
bfcf6218ed WEB API independent 2023-07-04 20:09:38 +08:00
aries_ckt
ef5a9b3b5e fix:web-ui domain bug 2023-07-04 19:51:13 +08:00
aries_ckt
1842d28a4f fix:web-ui domain bug 2023-07-04 19:51:13 +08:00
tuyang.yhj
d4846c2ee5 WEB API independent 2023-07-04 19:12:43 +08:00
tuyang.yhj
ac9468d93e WEB API independent 2023-07-04 19:12:43 +08:00
aries_ckt
dc390f1eca fix:merge web-api 2023-07-04 17:59:33 +08:00
aries_ckt
17e276b76f fix:merge web-api 2023-07-04 17:59:33 +08:00
aries_ckt
eb64f1bd3d Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:42:43 +08:00
aries_ckt
86dedf969a Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:42:43 +08:00
tuyang.yhj
cfd93585e0 WEB API independent 2023-07-04 17:41:44 +08:00
tuyang.yhj
d8e4e32102 WEB API independent 2023-07-04 17:41:44 +08:00
tuyang.yhj
edfdee4476 WEB API independent 2023-07-04 17:40:48 +08:00
tuyang.yhj
f451a599c7 WEB API independent 2023-07-04 17:40:48 +08:00
aries_ckt
17921fdd53 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:36:31 +08:00
aries_ckt
4c67f4cace Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:36:31 +08:00
tuyang.yhj
c4408a41ad WEB API independent 2023-07-04 17:36:09 +08:00
tuyang.yhj
efce1a9bde WEB API independent 2023-07-04 17:36:09 +08:00
aries_ckt
7f0a3410bd Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:25:30 +08:00
aries_ckt
1efaa55515 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 17:25:30 +08:00
tuyang.yhj
c547571c54 WEB API independent 2023-07-04 17:25:21 +08:00
tuyang.yhj
f02fe50aea WEB API independent 2023-07-04 17:25:21 +08:00
tuyang.yhj
33c7374168 WEB API independent 2023-07-04 17:19:18 +08:00
tuyang.yhj
314920b6e1 WEB API independent 2023-07-04 17:19:18 +08:00
tuyang.yhj
d6b4da7559 WEB API independent 2023-07-04 16:50:49 +08:00
tuyang.yhj
e8c61c29e2 WEB API independent 2023-07-04 16:50:49 +08:00
tuyang.yhj
f2a107b463 WEB API independent 2023-07-04 16:41:02 +08:00
tuyang.yhj
5f9c36a050 WEB API independent 2023-07-04 16:41:02 +08:00
aries_ckt
b50faddad0 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 14:29:10 +08:00
aries_ckt
80d9e1344e Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 14:29:10 +08:00
tuyang.yhj
fb9194df24 WEB API independent 2023-07-04 14:07:01 +08:00
tuyang.yhj
560773296e WEB API independent 2023-07-04 14:07:01 +08:00
aries_ckt
7fc28c1b30 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 13:45:40 +08:00
aries_ckt
4fcd133bb0 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 13:45:40 +08:00
tuyang.yhj
0825d6c64f WEB API independent 2023-07-04 13:45:06 +08:00
tuyang.yhj
72de9b2fa8 WEB API independent 2023-07-04 13:45:06 +08:00
aries_ckt
f7eb741753 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 11:40:15 +08:00
aries_ckt
d2e82d575e Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-07-04 11:40:15 +08:00
aries_ckt
2e68d6e28d feat:space return doc_count 2023-07-04 11:39:57 +08:00
aries_ckt
064b08dd23 feat:space return doc_count 2023-07-04 11:39:57 +08:00
tuyang.yhj
ef51167630 WEB API independent 2023-07-04 11:34:12 +08:00
tuyang.yhj
c23a32b906 WEB API independent 2023-07-04 11:34:12 +08:00
tuyang.yhj
f738ddc934 WEB API independent 2023-07-04 11:16:51 +08:00
tuyang.yhj
92dbe22504 WEB API independent 2023-07-04 11:16:51 +08:00
tuyang.yhj
7801de734c WEB API independent 2023-07-04 11:11:27 +08:00
tuyang.yhj
ef37f61e48 WEB API independent 2023-07-04 11:11:27 +08:00
tuyang.yhj
680518b08a WEB API independent 2023-07-04 11:04:22 +08:00
tuyang.yhj
15271026c2 WEB API independent 2023-07-04 11:04:22 +08:00
tuyang.yhj
5712b71c0f WEB API independent 2023-07-04 11:01:25 +08:00
tuyang.yhj
46ac6feb0f WEB API independent 2023-07-04 11:01:25 +08:00
tuyang.yhj
575ed36534 WEB API independent 2023-07-04 09:45:38 +08:00
tuyang.yhj
4cfa7bb40a WEB API independent 2023-07-04 09:45:38 +08:00
aries_ckt
723cd22507 refactor:knowledge api refactor
1.knowledge python file refactor
2.source embedding return vector_ids
2023-07-03 23:50:34 +08:00
aries_ckt
161fe4b358 refactor:knowledge api refactor
1.knowledge python file refactor
2.source embedding return vector_ids
2023-07-03 23:50:34 +08:00
tuyang.yhj
8d0f62fa83 Merge remote-tracking branch 'origin/new-page-framework' into dev_ty_06_end
# Conflicts:
#	pilot/server/webserver.py
2023-07-03 22:17:03 +08:00
tuyang.yhj
02b51291b7 Merge remote-tracking branch 'origin/new-page-framework' into dev_ty_06_end
# Conflicts:
#	pilot/server/webserver.py
2023-07-03 22:17:03 +08:00
aries_ckt
ba48fa3e08 Merge remote-tracking branch 'origin/new-page-framework' into llm_framework 2023-07-03 22:13:25 +08:00
aries_ckt
b3c7764190 Merge remote-tracking branch 'origin/new-page-framework' into llm_framework 2023-07-03 22:13:25 +08:00
tuyang.yhj
5a0b61c1f2 WEB API independent 2023-07-03 21:59:54 +08:00
tuyang.yhj
92920cdaa9 WEB API independent 2023-07-03 21:59:54 +08:00
aries_ckt
d8bb84771f Merge remote-tracking branch 'origin/new-page-framework' into llm_framework 2023-07-03 21:41:11 +08:00
aries_ckt
84f59a8c17 Merge remote-tracking branch 'origin/new-page-framework' into llm_framework 2023-07-03 21:41:11 +08:00
tuyang.yhj
c4bcbf55a9 WEB API independent 2023-07-03 21:26:53 +08:00
tuyang.yhj
be8ead568a WEB API independent 2023-07-03 21:26:53 +08:00
tuyang.yhj
29fc720c6f WEB API independent 2023-07-03 21:26:13 +08:00
tuyang.yhj
0cf3412f50 WEB API independent 2023-07-03 21:26:13 +08:00
aries_ckt
3bdc200baa refactor: code refactor 2023-07-03 21:05:23 +08:00
aries_ckt
be9e826edf refactor: code refactor 2023-07-03 21:05:23 +08:00
aries_ckt
7ee68c905b fix:embedding chunk update
integrate RecursiveCharacterTextSplitter
2023-07-03 20:06:38 +08:00
aries_ckt
770c4ae420 fix:embedding chunk update
integrate RecursiveCharacterTextSplitter
2023-07-03 20:06:38 +08:00
aries_ckt
07281d6bb5 refactor:merge tuyang_end_06 2023-07-03 18:59:37 +08:00
aries_ckt
6db837cd11 refactor:merge tuyang_end_06 2023-07-03 18:59:37 +08:00
tuyang.yhj
b3dde34ec4 WEB API independent 2023-07-03 18:37:25 +08:00
tuyang.yhj
85d834d5b4 WEB API independent 2023-07-03 18:37:25 +08:00
aries_ckt
22b029f288 fix:restore webserver db choose 2023-07-03 16:38:45 +08:00
aries_ckt
c93fcaaed8 fix:restore webserver db choose 2023-07-03 16:38:45 +08:00
tuyang.yhj
42d8b2b74b Merge branch 'llm_framework' into dev_ty_06_end 2023-07-03 16:28:56 +08:00
tuyang.yhj
b91a6f1c95 Merge branch 'llm_framework' into dev_ty_06_end 2023-07-03 16:28:56 +08:00
tuyang.yhj
30c7803451 WEB API independent 2023-07-03 16:17:32 +08:00
tuyang.yhj
a6097c4cb4 WEB API independent 2023-07-03 16:17:32 +08:00
aries_ckt
1868b228bc fix:knowledge_init path
1.knowledge_init path
2.url embedding chunk
2023-07-03 16:09:18 +08:00
aries_ckt
6b17a16bd0 fix:knowledge_init path
1.knowledge_init path
2.url embedding chunk
2023-07-03 16:09:18 +08:00
aries_ckt
8baa1d9464 refactor: webserver chat delete temperature, max_new_tokens 2023-07-03 15:03:23 +08:00
aries_ckt
b831ee5863 refactor: webserver chat delete temperature, max_new_tokens 2023-07-03 15:03:23 +08:00
aries_ckt
9137e413b6 fix:delete source_embedding
1.rename source_embedding to embedding_engine
2023-07-03 11:53:26 +08:00
aries_ckt
97c9cfbd6b fix:delete source_embedding
1.rename source_embedding to embedding_engine
2023-07-03 11:53:26 +08:00
tuyang.yhj
23ccf15166 WEB API independent 2023-07-03 11:18:57 +08:00
tuyang.yhj
1605ce53bf WEB API independent 2023-07-03 11:18:57 +08:00
tuyang.yhj
95737f94cd WEB API independent 2023-07-03 10:31:09 +08:00
tuyang.yhj
e5994cb588 WEB API independent 2023-07-03 10:31:09 +08:00
tuyang.yhj
354852f9df Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/server/static/_next/static/chunks/702.d4f5815f0f061322.js
#	pilot/server/static/_next/static/chunks/app/agents/page-4286c92088ccc4e9.js
#	pilot/server/static/_next/static/chunks/app/datastores/documents/chunklist/page-65ded782e5468079.js
#	pilot/server/static/_next/static/chunks/app/datastores/documents/page-0b797043cfee212f.js
#	pilot/server/static/_next/static/chunks/app/datastores/page-171d660b8104db30.js
2023-07-03 10:15:12 +08:00
tuyang.yhj
d8c1684243 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/server/static/_next/static/chunks/702.d4f5815f0f061322.js
#	pilot/server/static/_next/static/chunks/app/agents/page-4286c92088ccc4e9.js
#	pilot/server/static/_next/static/chunks/app/datastores/documents/chunklist/page-65ded782e5468079.js
#	pilot/server/static/_next/static/chunks/app/datastores/documents/page-0b797043cfee212f.js
#	pilot/server/static/_next/static/chunks/app/datastores/page-171d660b8104db30.js
2023-07-03 10:15:12 +08:00
tuyang.yhj
d7decb4d6a WEB API independent 2023-07-03 09:56:33 +08:00
tuyang.yhj
6b35be2808 WEB API independent 2023-07-03 09:56:33 +08:00
aries_ckt
f54b1cbdd4 fix:webserver path 2023-07-02 14:20:10 +08:00
aries_ckt
4dd5a4dc82 fix:webserver path 2023-07-02 14:20:10 +08:00
aries_ckt
3df9e9e4d2 feat:knowledge management
1.merge main branch
2.rebuild knowledge management
3.static js
2023-06-30 15:39:54 +08:00
aries_ckt
d95646d8b2 feat:knowledge management
1.merge main branch
2.rebuild knowledge management
3.static js
2023-06-30 15:39:54 +08:00
aries_ckt
933b0fa203 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-30 15:19:10 +08:00
aries_ckt
6ada78374e Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-30 15:19:10 +08:00
aries_ckt
c5a67cc5e2 style:format code 2023-06-30 15:04:33 +08:00
aries_ckt
f4aa58a954 style:format code 2023-06-30 15:04:33 +08:00
aries_ckt
57cce46a78 fix:knowledge_init.py multi document cannot search answser
1.rebuild knowledge_init.py
Close #285
2023-06-30 15:02:18 +08:00
aries_ckt
6fdeff9a0a fix:knowledge_init.py multi document cannot search answser
1.rebuild knowledge_init.py
Close #285
2023-06-30 15:02:18 +08:00
tuyang.yhj
9494371dc0 WEB API independent 2023-06-30 13:17:58 +08:00
tuyang.yhj
c621bf1e33 WEB API independent 2023-06-30 13:17:58 +08:00
tuyang.yhj
488f7da1ea WEB API independent 2023-06-30 13:16:43 +08:00
tuyang.yhj
aed2cb21a9 WEB API independent 2023-06-30 13:16:43 +08:00
aries_ckt
b074c487e9 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-30 10:43:35 +08:00
aries_ckt
1de0542015 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-30 10:43:35 +08:00
aries_ckt
29ac946855 fix:create document return id
create document return id
2023-06-30 10:39:47 +08:00
aries_ckt
d0a0d3bbdf fix:create document return id
create document return id
2023-06-30 10:39:47 +08:00
tuyang.yhj
01e068a92a WEB API independent 2023-06-30 10:02:03 +08:00
tuyang.yhj
a330714c61 WEB API independent 2023-06-30 10:02:03 +08:00
tuyang.yhj
39b0388ad2 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/openapi/api_v1/api_v1.py
#	pilot/server/dbgpt_server.py
2023-06-30 09:58:32 +08:00
tuyang.yhj
6f8f182d1d Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/openapi/api_v1/api_v1.py
#	pilot/server/dbgpt_server.py
2023-06-30 09:58:32 +08:00
tuyang.yhj
f7f88dc4b8 WEB API independent 2023-06-29 20:41:05 +08:00
tuyang.yhj
865822d1de WEB API independent 2023-06-29 20:41:05 +08:00
aries_ckt
45d183d50b fix:merge tuyang branch and knowledge chat
1.fix knowledge chat
2.merge tuyang branch
2023-06-29 20:03:39 +08:00
aries_ckt
4c4c028b21 fix:merge tuyang branch and knowledge chat
1.fix knowledge chat
2.merge tuyang branch
2023-06-29 20:03:39 +08:00
tuyang.yhj
53565c4fce WEB API independent 2023-06-29 19:30:14 +08:00
tuyang.yhj
35bdf71912 WEB API independent 2023-06-29 19:30:14 +08:00
tuyang.yhj
20666baa7c WEB API independent 2023-06-29 18:53:52 +08:00
tuyang.yhj
4abfa3c7e9 WEB API independent 2023-06-29 18:53:52 +08:00
aries_ckt
2ba2f38781 fix:use spacy replace chunk method
use spacy replace chunk method
2023-06-29 18:32:36 +08:00
aries_ckt
24130a6097 fix:use spacy replace chunk method
use spacy replace chunk method
2023-06-29 18:32:36 +08:00
aries_ckt
d96000ef35 fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 18:08:26 +08:00
aries_ckt
ff31d9a22b fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 18:08:26 +08:00
aries_ckt
73b1863c69 fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 18:00:55 +08:00
aries_ckt
96f3dcf095 fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 18:00:55 +08:00
aries_ckt
4466d92bba fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 17:46:53 +08:00
aries_ckt
f29a0a2472 fix:sync status idempotent
when RUNNING AND FINISHED cannot sync
2023-06-29 17:46:53 +08:00
aries_ckt
aad45a6b70 feat:chunk split method replace
chunk split method replace
2023-06-29 17:26:05 +08:00
aries_ckt
7ad629eb3d feat:chunk split method replace
chunk split method replace
2023-06-29 17:26:05 +08:00
tuyang.yhj
fe662cec5e WEB API independent 2023-06-29 17:24:18 +08:00
tuyang.yhj
8ea2abb29c WEB API independent 2023-06-29 17:24:18 +08:00
aries_ckt
a50694bf6e fix:solve upload file bug
solve upload file bug
2023-06-29 17:06:15 +08:00
aries_ckt
92c5e209cf fix:solve upload file bug
solve upload file bug
2023-06-29 17:06:15 +08:00
aries_ckt
9131fd574c fix:update knowledge schema sql
update knowledge schema sql
2023-06-29 16:34:12 +08:00
aries_ckt
b2f1b1319f fix:update knowledge schema sql
update knowledge schema sql
2023-06-29 16:34:12 +08:00
aries_ckt
90f73a9e82 fix:port define
can re-define port
2023-06-29 16:07:39 +08:00
aries_ckt
5951215c0b fix:port define
can re-define port
2023-06-29 16:07:39 +08:00
tuyang.yhj
7208dd6c88 WEB API independent 2023-06-29 15:33:14 +08:00
tuyang.yhj
64d4f1e368 WEB API independent 2023-06-29 15:33:14 +08:00
aries_ckt
4029f48d5f style:format code style
format code style
2023-06-29 13:52:53 +08:00
aries_ckt
cdb616cc21 style:format code style
format code style
2023-06-29 13:52:53 +08:00
aries_ckt
359babecdc Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-29 13:35:03 +08:00
aries_ckt
87b1159ff6 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-29 13:35:03 +08:00
tuyang.yhj
6a3bf33a24 WEB API independent 2023-06-29 11:58:13 +08:00
tuyang.yhj
3ce9d2faf2 WEB API independent 2023-06-29 11:58:13 +08:00
aries_ckt
1283b24a5f feat:chunks page list
add chunk page list
2023-06-29 11:21:48 +08:00
aries_ckt
06688b1c36 feat:chunks page list
add chunk page list
2023-06-29 11:21:48 +08:00
aries_ckt
219b61caae feat:chunks page list
1.add document chunk list
2023-06-29 11:20:16 +08:00
aries_ckt
4a57192879 feat:chunks page list
1.add document chunk list
2023-06-29 11:20:16 +08:00
tuyang.yhj
307ffd6d90 WEB API independent 2023-06-29 09:55:43 +08:00
tuyang.yhj
8e93833321 WEB API independent 2023-06-29 09:55:43 +08:00
tuyang.yhj
4dcfd1ddd7 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/memory/chat_history/duckdb_history.py
#	pilot/openapi/api_v1/api_v1.py
#	pilot/scene/base.py
#	pilot/scene/base_chat.py
#	pilot/scene/chat_execution/example.py
2023-06-28 11:40:22 +08:00
tuyang.yhj
caa1a41065 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/memory/chat_history/duckdb_history.py
#	pilot/openapi/api_v1/api_v1.py
#	pilot/scene/base.py
#	pilot/scene/base_chat.py
#	pilot/scene/chat_execution/example.py
2023-06-28 11:40:22 +08:00
tuyang.yhj
b2d2828b4e WEB API independent 2023-06-28 11:34:40 +08:00
tuyang.yhj
820214faa8 WEB API independent 2023-06-28 11:34:40 +08:00
aries_ckt
14387d9661 fix:return knowledge dict
format knowledge result
2023-06-28 10:35:55 +08:00
aries_ckt
4e4f8bd564 fix:return knowledge dict
format knowledge result
2023-06-28 10:35:55 +08:00
Data Hamal
b39760ef59 Update base.py
fix function __extract_json  slef --> self
2023-06-28 00:52:45 +08:00
Data Hamal
a4493b7472
Update base.py
fix function __extract_json  slef --> self
2023-06-28 00:52:45 +08:00
aries_ckt
7f979c0880 style:format code
format code
2023-06-27 22:20:21 +08:00
aries_ckt
682b1468d1 style:format code
format code
2023-06-27 22:20:21 +08:00
tuyang.yhj
1d3d6cb23c Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/openapi/api_v1/api_v1.py
2023-06-27 17:48:40 +08:00
tuyang.yhj
b8c55c2560 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/openapi/api_v1/api_v1.py
2023-06-27 17:48:40 +08:00
aries_ckt
544aed4e56 fix: knowledge embedding default parameter
1.knowledge embedding default parameter
2023-06-27 17:46:48 +08:00
aries_ckt
ac686e9c6f fix: knowledge embedding default parameter
1.knowledge embedding default parameter
2023-06-27 17:46:48 +08:00
tuyang.yhj
5777761320 WEB API independent 2023-06-27 17:45:07 +08:00
tuyang.yhj
8119edd5ad WEB API independent 2023-06-27 17:45:07 +08:00
aries_ckt
fa73a4fae6 feat: new knowledge chat scene
1.add new knowledge chat scene
2.format file format
2023-06-27 16:50:16 +08:00
aries_ckt
05683d94ba feat: new knowledge chat scene
1.add new knowledge chat scene
2.format file format
2023-06-27 16:50:16 +08:00
tuyang.yhj
5599bb63ea Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/connections/rdbms/py_study/pd_study.py
#	pilot/openapi/api_v1/api_v1.py
#	pilot/openapi/api_v1/api_view_model.py
#	pilot/scene/base.py
#	pilot/scene/base_chat.py
#	pilot/scene/message.py
#	pilot/server/webserver.py
2023-06-27 15:39:09 +08:00
tuyang.yhj
ca6afbd445 Merge branch 'llm_framework' into dev_ty_06_end
# Conflicts:
#	pilot/connections/rdbms/py_study/pd_study.py
#	pilot/openapi/api_v1/api_v1.py
#	pilot/openapi/api_v1/api_view_model.py
#	pilot/scene/base.py
#	pilot/scene/base_chat.py
#	pilot/scene/message.py
#	pilot/server/webserver.py
2023-06-27 15:39:09 +08:00
tuyang.yhj
b49ecc2668 WEB API independent 2023-06-27 15:35:18 +08:00
tuyang.yhj
3f7cc02426 WEB API independent 2023-06-27 15:35:18 +08:00
aries_ckt
a06342425b feat: knowledge backend management
1.knowledge_type.py
2.knowledge backend api
2023-06-27 15:29:13 +08:00
aries_ckt
57da3c23a6 feat: knowledge backend management
1.knowledge_type.py
2.knowledge backend api
2023-06-27 15:29:13 +08:00
staneyffer
2c96c16bea fix: documents chat not working with chatglm2-6b 2023-06-26 18:13:31 +08:00
staneyffer
b41be465ad fix: documents chat not working with chatglm2-6b 2023-06-26 18:13:31 +08:00
aries_ckt
db28894443 feat: knowledge management backend api
1.create knowledge space
2.list knowledge space
3.create knowledge document
4.list knowledge document
5.save document chunks
6.sync embedding document
2023-06-26 15:24:25 +08:00
aries_ckt
91d6edc4eb feat: knowledge management backend api
1.create knowledge space
2.list knowledge space
3.create knowledge document
4.list knowledge document
5.save document chunks
6.sync embedding document
2023-06-26 15:24:25 +08:00
magic.chen
132f8fff01 Update model_config.py 2023-06-25 23:29:43 +08:00
magic.chen
aa4115ef67
Update model_config.py 2023-06-25 23:29:43 +08:00
csunny
fc7cb1cce3 feat: add chatglm2-6b support 2023-06-25 23:05:50 +08:00
csunny
192b289480 feat: add chatglm2-6b support 2023-06-25 23:05:50 +08:00
aries_ckt
ee3a6ded7d Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-25 16:08:28 +08:00
aries_ckt
d5df445074 Merge remote-tracking branch 'origin/dev_ty_06_end' into llm_framework 2023-06-25 16:08:28 +08:00
tuyang.yhj
c57c2e60e8 WEB API independent 2023-06-25 15:32:41 +08:00
tuyang.yhj
9d3000fb26 WEB API independent 2023-06-25 15:32:41 +08:00
tuyang.yhj
04b4f6adf9 Merge branch 'llm_framework' into dev_ty_06_end 2023-06-25 15:31:09 +08:00
tuyang.yhj
1367f92955 Merge branch 'llm_framework' into dev_ty_06_end 2023-06-25 15:31:09 +08:00
tuyang.yhj
2bc4642345 Merge branch 'llm_framework' into DEV_TY_06 2023-06-25 14:47:30 +08:00
tuyang.yhj
03576cfc5d Merge branch 'llm_framework' into DEV_TY_06 2023-06-25 14:47:30 +08:00
tuyang.yhj
d753af1166 WEB API independent 2023-06-25 14:46:46 +08:00
tuyang.yhj
d372e73cd5 WEB API independent 2023-06-25 14:46:46 +08:00
aries_ckt
85fb12e3d0 style: format webserver.py
format file format
2023-06-22 23:39:23 +08:00
aries_ckt
cc422a2be4 style: format webserver.py
format file format
2023-06-22 23:39:23 +08:00
aries_ckt
9d305469ad fix: EMBEDDING_MODEL env config
solve the problem that EMBEDDING_MODEL config did not work
Close #264
2023-06-22 23:33:27 +08:00
aries_ckt
683ed09e10 fix: EMBEDDING_MODEL env config
solve the problem that EMBEDDING_MODEL config did not work
Close #264
2023-06-22 23:33:27 +08:00
chenketing
204f7618b1 fix: custom chat exception
fix custom chat exception
raise user can understand error
2023-06-20 19:50:00 +08:00
chenketing
f9437db07b fix: custom chat exception
fix custom chat exception
raise user can understand error
2023-06-20 19:50:00 +08:00
csunny
083791ca3b feat: define framework and split api
add cache for llm
add openapi module
add proxy module
2023-06-20 19:36:35 +08:00
csunny
50719c14b9 feat: define framework and split api
add cache for llm
add openapi module
add proxy module
2023-06-20 19:36:35 +08:00
aries-ckt
6b0ab59201 style: code format.
code style format
2023-06-19 16:58:24 +08:00
aries-ckt
c32f3f1766 style: code format.
code style format
2023-06-19 16:58:24 +08:00
aries-ckt
05a74d89cd fix: Weaviate document format.
1.similar search: docs format
2.conf SUMMARY_CONFIG
2023-06-19 16:44:18 +08:00
aries-ckt
3af16cf792 fix: Weaviate document format.
1.similar search: docs format
2.conf SUMMARY_CONFIG
2023-06-19 16:44:18 +08:00
aries-ckt
b95084b89f feat: integrate Weaviate vector database in DB-GPT.
1.Weaviate default schema update
2.Weaviate database config
3.requirement
2023-06-19 09:56:54 +08:00
aries-ckt
8299f5e0fa feat: integrate Weaviate vector database in DB-GPT.
1.Weaviate default schema update
2.Weaviate database config
3.requirement
2023-06-19 09:56:54 +08:00
LBYPatrick
0bb0246fb1 chore: run black against modified code 2023-06-16 12:23:28 +08:00
LBYPatrick
0b1d54afa6 chore: run black against modified code 2023-06-16 12:23:28 +08:00
LBYPatrick
5f8186a258 chore: bump requirement.txt for guanaco support 2023-06-16 11:45:42 +08:00
LBYPatrick
1580aaa8eb chore: bump requirement.txt for guanaco support 2023-06-16 11:45:42 +08:00
aries-ckt
b5008f0517 update:weaviate_store format 2023-06-15 10:20:08 +08:00
aries-ckt
ba713c6ba9 update:weaviate_store format 2023-06-15 10:20:08 +08:00
Aries-ckt
fba6efa8c1 - add Weaviate database (#222)
The contribution aims to enhance the functionality of the DBGPT
repository by integrating support for the Weaviate database. Weaviate is
a vector database that provides advanced indexing and search
capabilities for textual data. By incorporating Weaviate into the DBGPT
repository, users will have access to efficient storage, retrieval, and
similarity search features for their text-based data.

Proposed Changes:
1. Implement WeaviateStore Class:
- Create a new class, "WeaviateStore," that extends the existing vector
store functionality in the DBGPT repository.
- The WeaviateStore class will serve as a wrapper around the Weaviate
database and provide methods for data loading, searching, and
vectorization.
- The class will utilize the Weaviate Python client library for seamless
integration with the Weaviate database.

2. Schema Definition:
- Define the schema for the Weaviate database to support the required
data structure in the DBGPT repository.
- The schema will include a "Document" class with properties for
metadata and text.
- The "metadata" property will store the metadata associated with each
document.
- The "text" property will store the textual content of each document.

3. Data Loading:
- Implement a method within the WeaviateStore class to load documents
into the Weaviate database.
- Iterate through the documents in the DBGPT repository and extract the
necessary metadata and text.
- Use the Weaviate Python client to add each document to the Weaviate
database, mapping the metadata and text to the corresponding properties
defined in the schema.

4. Similar Search:
- Implement a method within the WeaviateStore class to perform a similar
search in the Weaviate database based on a given text query.
- Utilize Weaviate's vector-based search capabilities to find documents
similar to the provided text query.
- Return the relevant documents along with additional information such
as distance or relevance scores.

5. Vector Name Existence:
- Implement a method within the WeaviateStore class to check if a vector
name exists for a given class in the Weaviate database.
- The method will query the Weaviate database's schema and determine if
the vector name exists for the specified class.
2023-06-15 09:44:56 +08:00
Aries-ckt
f4bc71ad97 - add Weaviate database (#222)
The contribution aims to enhance the functionality of the DBGPT
repository by integrating support for the Weaviate database. Weaviate is
a vector database that provides advanced indexing and search
capabilities for textual data. By incorporating Weaviate into the DBGPT
repository, users will have access to efficient storage, retrieval, and
similarity search features for their text-based data.

Proposed Changes:
1. Implement WeaviateStore Class:
- Create a new class, "WeaviateStore," that extends the existing vector
store functionality in the DBGPT repository.
- The WeaviateStore class will serve as a wrapper around the Weaviate
database and provide methods for data loading, searching, and
vectorization.
- The class will utilize the Weaviate Python client library for seamless
integration with the Weaviate database.

2. Schema Definition:
- Define the schema for the Weaviate database to support the required
data structure in the DBGPT repository.
- The schema will include a "Document" class with properties for
metadata and text.
- The "metadata" property will store the metadata associated with each
document.
- The "text" property will store the textual content of each document.

3. Data Loading:
- Implement a method within the WeaviateStore class to load documents
into the Weaviate database.
- Iterate through the documents in the DBGPT repository and extract the
necessary metadata and text.
- Use the Weaviate Python client to add each document to the Weaviate
database, mapping the metadata and text to the corresponding properties
defined in the schema.

4. Similar Search:
- Implement a method within the WeaviateStore class to perform a similar
search in the Weaviate database based on a given text query.
- Utilize Weaviate's vector-based search capabilities to find documents
similar to the provided text query.
- Return the relevant documents along with additional information such
as distance or relevance scores.

5. Vector Name Existence:
- Implement a method within the WeaviateStore class to check if a vector
name exists for a given class in the Weaviate database.
- The method will query the Weaviate database's schema and determine if
the vector name exists for the specified class.
2023-06-15 09:44:56 +08:00
Younis Bashir
c9768a0948 - add Weaviate database 2023-06-15 02:51:36 +03:00
Younis Bashir
3a41904a32 - add Weaviate database 2023-06-15 02:51:36 +03:00
magic.chen
d910ee3f36 Update llmserver.py 2023-06-14 22:52:26 +08:00
magic.chen
f19b92af02 Update llmserver.py 2023-06-14 22:52:26 +08:00
csunny
8d26889280 Merge branch 'main' into llm_fxp 2023-06-14 22:32:17 +08:00
csunny
c522f4f0ba Merge branch 'main' into llm_fxp 2023-06-14 22:32:17 +08:00
aries-ckt
1bef83a13e fix:format 2023-06-14 22:22:27 +08:00
aries-ckt
d07d103db9 fix:format 2023-06-14 22:22:27 +08:00
csunny
71db2a8ef6 Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into llm_fxp 2023-06-14 22:04:35 +08:00
csunny
321f1c36c4 Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into llm_fxp 2023-06-14 22:04:35 +08:00
csunny
30c533515a fix: async output 2023-06-14 22:02:23 +08:00
csunny
d0b270cb95 fix: async output 2023-06-14 22:02:23 +08:00
yhjun1026
42a39120c3 async auto load plugin 2023-06-14 21:56:38 +08:00
yhjun1026
04335465df async auto load plugin 2023-06-14 21:56:38 +08:00
yhjun1026
48eeb3dcb8 async auto load plugin 2023-06-14 21:54:43 +08:00
yhjun1026
88d1709905 async auto load plugin 2023-06-14 21:54:43 +08:00
yhjun1026
3a6501ba96 Merge branch 'dbgpt_doc' into ty_test
# Conflicts:
#	pilot/common/plugins.py
2023-06-14 21:53:08 +08:00
yhjun1026
ddd8e7a8c5 Merge branch 'dbgpt_doc' into ty_test
# Conflicts:
#	pilot/common/plugins.py
2023-06-14 21:53:08 +08:00
yhjun1026
cc4d70d4d5 async auto load plugin 2023-06-14 21:51:05 +08:00
yhjun1026
6b1f00f7c3 async auto load plugin 2023-06-14 21:51:05 +08:00
yhjun1026
eec43dbfd5 async auto load plugin 2023-06-14 21:46:30 +08:00
yhjun1026
8ba409f305 async auto load plugin 2023-06-14 21:46:30 +08:00
yhjun1026
db3b0cae50 close auto load plugin 2023-06-14 21:40:08 +08:00
yhjun1026
d784e7e00a close auto load plugin 2023-06-14 21:40:08 +08:00
yhjun1026
f36d8223a3 close auto load plugin 2023-06-14 21:28:06 +08:00
yhjun1026
b2ec087322 close auto load plugin 2023-06-14 21:28:06 +08:00
xuyuan23
677bc30e18 Merge branch 'dbgpt_doc' into feature-xuyuan-openai-proxy 2023-06-14 17:55:32 +08:00
xuyuan23
6a5b0170ba Merge branch 'dbgpt_doc' into feature-xuyuan-openai-proxy 2023-06-14 17:55:32 +08:00
xuyuan23
621a859be0 add use cases: tool_use_with_plugin, and how to write a plugin. 2023-06-14 17:24:31 +08:00
xuyuan23
7b77360286 add use cases: tool_use_with_plugin, and how to write a plugin. 2023-06-14 17:24:31 +08:00
aries-ckt
8980de9be4 doc:db-gpt doc 2023-06-14 15:31:11 +08:00
aries-ckt
0c8b424b04 doc:db-gpt doc 2023-06-14 15:31:11 +08:00
aries-ckt
2fdc7fb139 fix:default chunk size 2023-06-14 12:37:45 +08:00
aries-ckt
333aad7bc4 fix:default chunk size 2023-06-14 12:37:45 +08:00
magic.chen
001c6e7845 add llm support for gpt4all (#209)
add llm support for gpt4all #178 #138
2023-06-14 11:35:42 +08:00
magic.chen
e3f91e98b4 add llm support for gpt4all (#209)
add llm support for gpt4all #178 #138
2023-06-14 11:35:42 +08:00
magic.chen
33c6a4bf54 Multi gpu (#207)
support multi gpus
2023-06-14 10:22:09 +08:00
magic.chen
713bdb77db Multi gpu (#207)
support multi gpus
2023-06-14 10:22:09 +08:00
csunny
ff6d3a7035 pylint: multi model for gp4all (#138) 2023-06-14 10:17:53 +08:00
csunny
4f82cfde63 pylint: multi model for gp4all (#138) 2023-06-14 10:17:53 +08:00
csunny
3927c26dea Merge branch 'dbgpt_doc' into llm_fxp 2023-06-14 10:14:13 +08:00
csunny
0f4569e5c8 Merge branch 'dbgpt_doc' into llm_fxp 2023-06-14 10:14:13 +08:00
zhanghy-sketchzh
00d24101f3 support multi gpus 2023-06-14 00:22:02 +08:00
magic.chen
7a75531a2d fix:default chunk size (#205)
fix:default chunk size
2023-06-13 23:54:19 +08:00
magic.chen
c67d0ab4d0 fix:default chunk size (#205)
fix:default chunk size
2023-06-13 23:54:19 +08:00
aries-ckt
61e71ed38b fix:default chunk size 2023-06-13 23:07:26 +08:00
magic.chen
e03a332848 fix:webserver DB chat (#204)
fix: webserver for DB chat
2023-06-13 22:56:42 +08:00
magic.chen
f9b27a0c41 fix:webserver DB chat (#204)
fix: webserver for DB chat
2023-06-13 22:56:42 +08:00
aries-ckt
7f4d66151d fix:doc for DB chat 2023-06-13 22:55:02 +08:00
yhjun1026
1a5052e121 Merge branch 'dbgpt_doc' into ty_test 2023-06-13 22:39:12 +08:00
yhjun1026
d5c519f49f Merge branch 'dbgpt_doc' into ty_test 2023-06-13 22:39:12 +08:00
yhjun1026
9b8adc5d6c fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 22:38:10 +08:00
yhjun1026
449515fe13 fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 22:38:10 +08:00
csunny
44df4f2509 feature: add plugin of dashboard (#201) 2023-06-13 21:44:27 +08:00
csunny
25c34cb48f feature: add plugin of dashboard (#201) 2023-06-13 21:44:27 +08:00
csunny
44e8fc0928 fix: conflicts 2023-06-13 21:41:18 +08:00
csunny
77d2abba5d fix: conflicts 2023-06-13 21:41:18 +08:00
csunny
05acabddf0 Merge branch 'ty_test' of https://github.com/csunny/DB-GPT into dbgpt_doc 2023-06-13 21:39:33 +08:00
csunny
a00bb87047 Merge branch 'ty_test' of https://github.com/csunny/DB-GPT into dbgpt_doc 2023-06-13 21:39:33 +08:00
xuyuan23
f755c533cd solve merge conflict. 2023-06-13 21:22:05 +08:00
csunny
d839180d67 Todo: add retry for generate 2023-06-13 21:17:03 +08:00
yhjun1026
8876bd2a7a fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 21:03:21 +08:00
yhjun1026
30ecd9f005 fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 21:03:21 +08:00
yhjun1026
3853c43d8b fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 20:34:33 +08:00
yhjun1026
dc0c82abc1 fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 20:34:33 +08:00
yhjun1026
19e3679d9f fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 20:33:34 +08:00
yhjun1026
18bacbd7f7 fix plugin mode bug;Optimize the parsing logic for model response 2023-06-13 20:33:34 +08:00
aries-ckt
38ca7c1cb2 fix:knowledge init 2023-06-13 19:50:10 +08:00
csunny
1f78c21c08 debug: more detail error info 2023-06-13 19:46:03 +08:00
csunny
77bc959819 Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into llm_fxp 2023-06-13 19:26:07 +08:00
aries-ckt
669e5cc3dc update:db chat 2023-06-13 19:20:19 +08:00
csunny
e057f4d3af Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into llm_fxp 2023-06-13 18:02:38 +08:00
sheri528
fcdc3b600d Merge remote-tracking branch 'upstream/llm_fxp' into dev_gpt4all 2023-06-13 17:48:36 +08:00
xuyuan23
acc2c5806c remove comment code 2023-06-13 17:45:49 +08:00
xuyuan23
24457dc286 reformat file proxy_llm.py 2023-06-13 17:42:11 +08:00
aries-ckt
7aa59596d2 update:db chat 2023-06-13 17:12:20 +08:00
xuyuan23
6a8ee91834 add plugin_env file, define plugin config strategy. 2023-06-13 15:58:24 +08:00
yhjun1026
4e5ce4d98b Merge remote-tracking branch 'origin/feature-xuyuan-openai-proxy' into ty_test
# Conflicts:
#	pilot/model/llm_out/proxy_llm.py
2023-06-13 15:17:06 +08:00
yhjun1026
4690ac26ea fix 2023-06-13 15:14:50 +08:00
sheri528
cc3c2d7799 update sleep interval 2023-06-13 14:35:14 +08:00
sheri528
5da4b38964 format code 2023-06-13 14:22:55 +08:00