Commit Graph

1293 Commits

Author SHA1 Message Date
yhjun1026
cd0469fdc4 add plugin mode 2023-05-30 19:29:41 +08:00
csunny
16c6986666 fix: lint 2023-05-30 19:11:34 +08:00
csunny
1bbed02a3c fix: token 2023-05-30 18:55:53 +08:00
yhjun1026
981d8c420e Merge branch 'llm_proxy' into dev
# Conflicts:
#	pilot/server/webserver.py
2023-05-30 17:21:40 +08:00
yhjun1026
5150cfcf55 add plugin mode 2023-05-30 17:20:37 +08:00
csunny
ea334b172e feature: add model server proxy 2023-05-30 17:16:29 +08:00
csunny
4c60ab1ea2 Merge branch 'main' into llm_fxp 2023-05-30 14:19:35 +08:00
yhjun1026
dd5fc529e2 Merge branch 'main' into dev
# Conflicts:
#	pilot/connections/mysql.py
#	pilot/prompts/prompt_generator.py
#	pilot/scene/base_chat.py
#	pilot/scene/chat_db/chat.py
#	pilot/scene/chat_db/out_parser.py
#	pilot/scene/chat_execution/chat.py
#	pilot/server/webserver.py
2023-05-30 10:57:57 +08:00
yhjun1026
9511cdb10a add plugin mode 2023-05-30 10:45:12 +08:00
sbabybird
459433824c 修正qa_prompt_template中的错别字 2023-05-30 10:17:12 +08:00
yhjun1026
20edf6daaa add plugin mode 2023-05-29 19:32:20 +08:00
csunny
cfd72331ac feature: add guanaco adapter 2023-05-29 17:59:50 +08:00
xuyuan23
6182c89ac0 Modify the English label expression 2023-05-28 22:09:41 +08:00
xuyuan23
d67f149052 Introduction to the usage method of adding multi-language interface support 2023-05-28 22:00:57 +08:00
xuyuan23
49d174336a reformatted file 'conversation' 2023-05-28 21:09:01 +08:00
xuyuan23
d24c160cd8 modify file conversation using config language, and fix 'sql_schema_info' format 2023-05-28 21:06:03 +08:00
xuyuan23
b9570e395e use tool 'black' to check and reformated files 2023-05-28 18:27:20 +08:00
xuyuan23
7fa205aefc add multi language support. 2023-05-28 17:37:33 +08:00
csunny
b00a47a0ee fix: lint 2023-05-25 23:56:03 +08:00
csunny
80e518708f fix: mr 2023-05-25 23:14:35 +08:00
aries-ckt
8fe5db9137 update:merge store_connector 2023-05-25 23:06:02 +08:00
aries-ckt
23929d1c42 update:merge dev 2023-05-25 22:54:12 +08:00
aries-ckt
b42e8e4549 update:merge dev branch 2023-05-25 21:51:52 +08:00
csunny
252948e272 fix: merge 2023-05-25 20:55:06 +08:00
csunny
e95696c23d lint: fix 2023-05-25 20:39:04 +08:00
aries-ckt
8eb266069f update:milvus text_field max length 2023-05-25 19:58:32 +08:00
yhjun1026
7a172344be 多场景对话架构一期0525 2023-05-25 19:51:30 +08:00
yhjun1026
57519b9006 多场景对话架构一期0525 2023-05-25 19:50:10 +08:00
yhjun1026
6ca0385358 多场景对话架构一期0525 2023-05-25 19:45:11 +08:00
aries-ckt
c0d62f3620 update:test milvus 2023-05-25 19:30:34 +08:00
yhjun1026
623205d35f 多场景对话架构一期0525 2023-05-25 18:54:32 +08:00
aries-ckt
723243d0cd update:milvus_batch size 2023-05-25 17:42:42 +08:00
aries-ckt
6c964c8a3d update:config env 2023-05-25 17:24:41 +08:00
aries-ckt
adb8a5a316 update:milvus batch 2023-05-25 17:17:02 +08:00
aries-ckt
85906a3c45 update:milvus append knowledge 2023-05-25 14:39:14 +08:00
aries-ckt
d3567fb984 update:default knowledge init 2023-05-25 13:01:30 +08:00
yhjun1026
0e4955a62a Merge remote-tracking branch 'origin/dbgpt_doc' into dev
# Conflicts:
#	pilot/server/webserver.py
2023-05-25 11:40:40 +08:00
yhjun1026
64ea33fede Merge remote-tracking branch 'origin/main' into dev
# Conflicts:
#	pilot/configs/config.py
#	pilot/connections/mysql.py
#	pilot/conversation.py
#	pilot/server/webserver.py
2023-05-25 10:22:38 +08:00
yhjun1026
ff99723014 多场景对架构一期0525 2023-05-25 10:04:25 +08:00
csunny
e4d565b56f merge: main 2023-05-25 01:14:24 +08:00
csunny
1733884caf db: open dblist get 2023-05-25 01:06:40 +08:00
yihong0618
8fc736f6c8 chore: merge main 2023-05-24 18:46:06 +08:00
yihong0618
b098a48898 ci: make ci happy lint the code, delete unused imports
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2023-05-24 18:43:04 +08:00
yhjun1026
2fc62c16ef 多场景对架构一期 2023-05-24 17:33:40 +08:00
aries-ckt
94a418897a update:config env 2023-05-24 16:28:13 +08:00
aries-ckt
4ef9ada7dc Merge remote-tracking branch 'origin/main' into store_connector 2023-05-24 16:19:33 +08:00
aries-ckt
977a88509e update:config env 2023-05-24 15:22:10 +08:00
yihong0618
9dc542ca45 fix: dotenv can not load
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
2023-05-24 15:18:06 +08:00
yihong0618
60ecde5892 fix: can not answer on mac m1-> mps device 2023-05-24 12:33:41 +08:00
aries-ckt
926c971691 update:PDF loader 2023-05-23 22:43:07 +08:00
aries-ckt
24d6762d96 update:vector store config 2023-05-23 22:16:08 +08:00
aries-ckt
b0d3d02d20 update:vector store config 2023-05-23 22:10:15 +08:00
aries-ckt
74c1f1f7e1 update:vector store config 2023-05-23 22:09:22 +08:00
aries-ckt
ef64935145 update:vector store config 2023-05-23 22:06:07 +08:00
aries-ckt
90b793f40e Merge remote-tracking branch 'origin/main' into store_connector 2023-05-23 22:04:03 +08:00
halfss
a1b4c92f6b Update utils.py
get_gpu_memory should return after the loop is over
2023-05-23 14:24:00 +08:00
aries-ckt
983a00f53a feature:vector store connector 2023-05-23 10:50:43 +08:00
aries-ckt
b70cb8076d update:merge main branch 2023-05-22 14:07:18 +08:00
aries-ckt
0297fa425b feature:add milvus store 2023-05-21 16:40:18 +08:00
csunny
a3fae0bdf2 add chatglm support 2023-05-21 16:30:03 +08:00
aries-ckt
6747d877cc feature:add milvus store 2023-05-21 16:29:00 +08:00
csunny
5ec1f413b6 update 2023-05-21 16:18:33 +08:00
csunny
604d269797 fix and update 2023-05-21 16:11:52 +08:00
csunny
89970bd71c llms: add cpu support 2023-05-21 16:05:53 +08:00
csunny
f52c7523b5 llms: fix 2023-05-21 14:54:16 +08:00
csunny
ce72820085 llms: add mps support 2023-05-21 14:48:54 +08:00
csunny
7b454d8867 llms: add chatglm model 2023-05-21 14:08:18 +08:00
csunny
42b76979a3 llms: multi model support 2023-05-21 11:22:56 +08:00
csunny
8e127b3863 llms: add chatglm 2023-05-21 10:13:59 +08:00
csunny
370e327bf3 add chatglm model 2023-05-20 16:23:07 +08:00
csunny
cbf1d0662a llms: add models 2023-05-20 16:06:32 +08:00
csunny
c0532246af llm: add chatglm 2023-05-20 15:45:43 +08:00
csunny
b466f4afdb Merge branch 'main' into llm_fxp 2023-05-20 14:23:20 +08:00
hyj1991
67f5bbc96a feat: support customizing port for llmserver 2023-05-19 22:33:50 +08:00
csunny
5acd3c1f3c merge master 2023-05-19 22:24:09 +08:00
csunny
e2f18fc187 add multi adapter 2023-05-19 21:44:54 +08:00
aries-ckt
336ba1e042 update:knowledge load script 2023-05-19 21:17:39 +08:00
csunny
9a1e54ebd4 top_k update 2023-05-18 23:31:15 +08:00
csunny
262a703905 Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into dev 2023-05-18 22:33:49 +08:00
aries-ckt
21076a98fb update:knowledge only one conversation 2023-05-18 22:33:21 +08:00
csunny
7c68a4f44e docs: update 2023-05-18 21:32:51 +08:00
csunny
ae0a046b98 update 2023-05-18 21:29:03 +08:00
csunny
caf4705f3b fix: update 2023-05-18 20:29:30 +08:00
csunny
3625d76c61 fix: config 2023-05-18 20:27:10 +08:00
csunny
f131d20c21 Merge branch 'dbgpt_doc' of https://github.com/csunny/DB-GPT into dev 2023-05-18 20:23:21 +08:00
aries-ckt
c82907c963 feature:knowledge embedding update 2023-05-18 20:23:06 +08:00
csunny
85cb42f5f0 fix: merge embedding 2023-05-18 20:18:41 +08:00
aries-ckt
2656a8030e feature:knowledge embedding update 2023-05-18 20:03:24 +08:00
aries-ckt
e59c3834eb update:merge 2023-05-18 19:52:59 +08:00
aries-ckt
e50c04ead2 feature:chn splitter 2023-05-18 19:48:28 +08:00
csunny
0d370a1a64 cfg: update 2023-05-18 17:32:53 +08:00
csunny
9ddd089381 fix run path 2023-05-18 17:28:06 +08:00
yhjun1026
b5139ea643 EN Note 2023-05-18 16:56:02 +08:00
yhjun1026
28cd4bb496 Merge remote-tracking branch 'origin/dev' into oconfig_major
# Conflicts:
#	README.en.md
#	README.md
2023-05-18 16:48:48 +08:00
yhjun1026
f7edd6dc93 Unified configuration 2023-05-18 16:47:06 +08:00
yhjun1026
ba7e23d37f Unified configuration 2023-05-18 16:30:57 +08:00
csunny
8d16a02785 globalization, upgrade 2023-05-18 16:20:09 +08:00
csunny
4302ae9087 Add: multi model support 2023-05-18 15:44:29 +08:00
aries-ckt
b92ecf2199 fix:prompt 2023-05-18 15:39:28 +08:00
aries-ckt
e8a7fd4546 fix:log 2023-05-17 23:12:00 +08:00
aries-ckt
c0115061c2 update:pdf split chunk 2023-05-17 23:03:51 +08:00
aries-ckt
3084123cef update:prompt length 2023-05-17 22:50:28 +08:00
aries-ckt
406c5fa483 update:config update 2023-05-17 22:26:49 +08:00
aries-ckt
def9fd8330 fix:update model name 2023-05-17 22:24:25 +08:00
aries-ckt
2bdfcdec93 update: replace embedding model 2023-05-17 22:12:22 +08:00
aries-ckt
32975cdf73 update:text splitter 2023-05-17 18:40:31 +08:00
aries-ckt
77925a9f47 feature:merge source-embedding 2023-05-15 23:15:47 +08:00
csunny
5a5fba5d18 Merge Plugin 2023-05-15 22:16:28 +08:00
aries-ckt
ce4c3e823d feature:add knowledge embedding 2023-05-15 22:12:50 +08:00
csunny
a3af2f2b9e convert file address 2023-05-15 17:27:55 +08:00
yhjun1026
e2750fcea0 插件输出优化 2023-05-15 14:18:08 +08:00
chenketing
1a0e386137 fix:unusual file 2023-05-15 00:18:06 +08:00
chenketing
9910ead684 update:model_config 2023-05-14 23:41:28 +08:00
chenketing
a498f87bbb feature:add markdown embedding 2023-05-14 23:28:35 +08:00
chenketing
293ba94d22 feature:add markdown embedding 2023-05-14 23:26:05 +08:00
chenketing
8ee288a8fd feature:web server knowledge embedding 2023-05-14 22:12:20 +08:00
chenketing
88d23c2147 Merge remote-tracking branch 'origin/plugin_init' into source_embedding 2023-05-14 22:07:47 +08:00
tuyang.yhj
d5b5fc4f9a bug fix 3 2023-05-14 21:59:40 +08:00
tuyang.yhj
fe71613970 bug fix2 2023-05-14 21:57:12 +08:00
tuyang.yhj
5b75ee7e96 bug fix 2023-05-14 21:54:13 +08:00
tuyang.yhj
67a40dba94 多轮对话 2023-05-14 21:25:13 +08:00
tuyang.yhj
fee5e769e7 多轮对话 2023-05-14 21:10:08 +08:00
tuyang.yhj
8721ea12c1 Merge branch 'plugin_init' of https://github.com/csunny/DB-GPT into plugin_init 2023-05-14 21:09:42 +08:00
tuyang.yhj
1b72dc6605 多轮对话使用插件 2023-05-14 20:45:03 +08:00
csunny
7ee0805eff fix 2023-05-13 23:43:05 +08:00
csunny
18da8e00eb update 2023-05-13 23:39:09 +08:00
csunny
a4e1a332ad fix error 2023-05-13 23:25:37 +08:00
tuyang.yhj
311ae7ada5 Merge branch 'plugin_init' of https://github.com/csunny/DB-GPT into plugin_init 2023-05-13 23:04:57 +08:00
tuyang.yhj
96c8d14cf1 插件输出结果到对话框 2023-05-13 23:00:59 +08:00
csunny
2a2382a902 update 2023-05-13 22:50:37 +08:00
tuyang.yhj
8afee1070e model server fix 2023-05-13 21:42:56 +08:00
tuyang.yhj
c9b440e381 bug fix 2023-05-13 21:34:24 +08:00
tuyang.yhj
bde8503620 同步服务接口 2023-05-13 21:24:05 +08:00
chenketing
6ca42e36dc Merge remote-tracking branch 'origin/plugin_init' into source_embedding 2023-05-13 21:01:28 +08:00
tuyang.yhj
c3eddb9756 合并 2023-05-12 23:53:21 +08:00
tuyang.yhj
9df9ed9558 删除测试代码 2023-05-12 23:47:09 +08:00
tuyang.yhj
416205ae7a 插件启动接入 2023-05-12 23:40:37 +08:00
chenketing
e44dff4170 Merge remote-tracking branch 'origin/plugin_init' into source_embedding 2023-05-12 21:06:00 +08:00
csunny
47b55b1c91 fix 2023-05-12 20:47:46 +08:00
csunny
0c8723f00c mv vicuna2llmserver 2023-05-12 20:20:23 +08:00
csunny
0a27d8ff7e fix error 2023-05-12 20:15:38 +08:00
csunny
b9df562c84 fix confilict 2023-05-12 20:12:47 +08:00
csunny
c29c0c9b82 fix 2023-05-12 18:23:49 +08:00
tuyang.yhj
192db2236a resovle confilict 2023-05-12 17:38:30 +08:00
tuyang.yhj
b8b7b93d82 support plugin 2023-05-12 17:36:13 +08:00
tuyang.yhj
7e1f95d19d 支持插件的prompt 2023-05-12 17:22:13 +08:00
chenketing
477c20514b feature:milvus vector store 2023-05-12 16:53:10 +08:00
tuyang.yhj
5f1d327901 兼容autogpt插件模式 2023-05-12 16:12:28 +08:00
tuyang.yhj
1590241889 load plugin 2023-05-12 13:57:35 +08:00
chenketing
d42a9f3bd1 feature:url,csv embedding 2023-05-11 23:48:56 +08:00
csunny
122a91593b remove openai api 2023-05-11 21:05:34 +08:00
chenketing
ed855df01d feature:pdf embedding test 2023-05-11 20:28:15 +08:00
chenketing
0c241dfaad feature:source embedding 2023-05-11 16:06:18 +08:00
csunny
ca50c9fe47 fix 2023-05-11 15:40:12 +08:00
csunny
e132980127 add token size 2023-05-11 13:30:57 +08:00
csunny
144c6e0148 fix 2023-05-11 11:15:58 +08:00
csunny
6d76825a10 rm fschat relay 2023-05-11 10:59:08 +08:00
csunny
9b813a801a fix and update 2023-05-10 21:02:50 +08:00
chenketing
365319a86c embedding 2023-05-10 20:58:35 +08:00
csunny
eb069f1a45 update 2023-05-10 20:52:31 +08:00
tuyang.yhj
f684a7f6f0 兼容autogpt plugin load 2023-05-10 16:42:08 +08:00
csunny
fd8bc8d169 modelLoader use singleton 2023-05-10 10:53:48 +08:00
csunny
bfbbf0ba88 update conversation 2023-05-09 21:48:47 +08:00
csunny
5fe17c7c1c update 2023-05-09 14:59:39 +08:00
csunny
9313174605 add auto conversation 2023-05-09 14:14:27 +08:00
csunny
60d5a2ffc6 Add: config 2023-05-09 11:18:06 +08:00
csunny
71fa957b58 impl llm utils 2023-05-09 00:41:46 +08:00
csunny
9e7a68349a update config 2023-05-09 00:15:19 +08:00
csunny
25fd7450cc rm oceanbase document 2023-05-08 23:01:52 +08:00
csunny
608244945b Merge branch 'dev' of https://github.com/csunny/DB-GPT into dev 2023-05-08 22:21:55 +08:00
csunny
af7c938a7f rm pdf document 2023-05-08 22:17:52 +08:00
csunny
4df5c23b00 update 2023-05-08 21:19:56 +08:00
csunny
dfdf08aa9b Merge branch 'dev' of https://github.com/csunny/DB-GPT into dev 2023-05-08 21:07:13 +08:00
csunny
8fb917c8ab fix some error 2023-05-08 21:04:50 +08:00
csunny
922d2e4f28 update mysql conn name 2023-05-08 00:44:58 +08:00
csunny
3ce31d5ea0 add connector file 2023-05-08 00:44:02 +08:00
csunny
d746086694 adjust project content 2023-05-08 00:34:36 +08:00
csunny
2252b9b6ba update ignore file 2023-05-07 22:51:34 +08:00
csunny
2124d78102 auto 2023-05-07 22:38:44 +08:00
csunny
42d3eec3ae add ft code 2023-05-07 22:36:21 +08:00
csunny
4985e23b11 add next roadmap 2023-05-07 20:24:44 +08:00
csunny
55b3702aeb knownledge base answer fix 2023-05-07 17:58:24 +08:00
csunny
56e9cde86e fetch top3 similar answer 2023-05-07 17:32:10 +08:00
csunny
e348313405 update readme 2023-05-07 15:40:10 +08:00
csunny
3c40659527 langchain qa base 2023-05-07 14:47:15 +08:00
csunny
63586fc6a3 update config 2023-05-07 13:36:24 +08:00
csunny
cbe024ebde init doc2vector 2023-05-07 12:54:51 +08:00
csunny
239895f7bc rely file local 2023-05-07 05:30:36 +08:00
csunny
4ce257e84f Merge branch 'dev' of github.com:csunny/DB-GPT into dev 2023-05-07 05:15:09 +08:00
csunny
539e98f1dc fork file replace import 2023-05-07 05:14:43 +08:00
csunny
5fbd83e573 fix 2023-05-06 01:13:47 +08:00
csunny
c1758f030b knownledge based qa 2023-05-06 00:41:35 +08:00
csunny
529f077409 load base knownledge 2023-05-05 23:42:51 +08:00
csunny
d9f5130db4 Merge branch 'dev' of github.com:csunny/DB-GPT into dev 2023-05-05 22:44:36 +08:00
csunny
1e9934eb03 update 2023-05-05 22:44:21 +08:00
csunny
d91a0e7d56 update requirements 2023-05-05 22:29:33 +08:00
csunny
7da910b642 add gradio tem 2023-05-05 22:14:28 +08:00
csunny
205eab7268 sentence transformer 2023-05-05 21:40:23 +08:00
csunny
b7b4a1fb63 update 2023-05-05 20:21:39 +08:00
csunny
a164d2f156 update config file 2023-05-05 20:06:24 +08:00
csunny
ffeb5040cc 添加模型 2023-05-04 15:00:21 +08:00
csunny
88a5c57646 connect database 2023-05-03 22:10:35 +08:00
csunny
a71c8b6d56 connect database 2023-05-03 18:40:36 +08:00
csunny
8eb37122c4 Merge branch 'dev' of github.com:csunny/DB-GPT into dev 2023-05-03 16:28:00 +08:00
csunny
917cf37e9f Merge branch 'dev' of https://github.com/csunny/DB-GPT into dev 2023-05-03 16:26:09 +08:00
csunny
6d1d61749e init package 2023-05-03 16:19:38 +08:00
csunny
af0b974398 update 2023-05-03 15:49:29 +08:00
csunny
943cffa3a9 add prompt 2023-05-01 00:12:03 +08:00
csunny
ed9b62d9d3 fix problem 2023-04-30 23:59:11 +08:00
csunny
7861fc28ce fix problem 2023-04-30 23:58:32 +08:00
csunny
c34e722412 version align 2023-04-30 23:16:10 +08:00
csunny
4243211220 test 2023-04-30 22:24:06 +08:00
csunny
7af5433ae3 test and fix 2023-04-30 22:07:03 +08:00
csunny
eef244fe92 rebuild params 2023-04-30 21:54:49 +08:00
csunny
f0e17ed8f1 handler request sync 2023-04-30 21:27:55 +08:00
csunny
905f14cf7c add debug log 2023-04-30 21:21:42 +08:00
csunny
65ead15b65 add darm mode 2023-04-30 21:03:47 +08:00
csunny
90dd34e25a impl gradio web 2023-04-30 20:49:10 +08:00
csunny
d73cab9c4b add stream output 2023-04-30 16:05:31 +08:00
csunny
909045c0d6 update 2023-04-30 14:52:03 +08:00
csunny
e493f54804 fix multi device error 2023-04-30 14:47:33 +08:00
csunny
7c69dc248a checkout load_model to fastchat 2023-04-30 14:21:58 +08:00
csunny
4381e21d0c add conversation prompt 2023-04-30 14:09:13 +08:00
csunny
00c0c20276 add knownledge base QA 2023-04-29 23:28:11 +08:00
csunny
eca14bc038 fix load model gpu oom 2023-04-29 23:02:13 +08:00
csunny
ca29dacc37 update 2023-04-29 22:55:21 +08:00
csunny
80dac77b7a gpu out of memory 2023-04-29 22:30:42 +08:00
csunny
a0f44efba5 Merge branch 'dev' of https://github.com/csunny/DB-GPT into dev 2023-04-29 21:52:36 +08:00
csunny
acf9dbbd82 fix problem 2023-04-29 21:50:47 +08:00
csunny
1b70b5f92b fix merge problem 2023-04-29 21:29:29 +08:00
csunny
0767537606 add vicuna embedding 2023-04-29 18:28:42 +08:00
csunny
4b2e3bf59a run a demo 2023-04-29 15:17:48 +08:00
csunny
c971f6ec58 update 2023-04-29 01:44:33 +08:00
csunny
2ea2c97a40 add prompt 2023-04-29 01:44:12 +08:00
csunny
7237a261f9 update 2023-04-29 01:26:19 +08:00
csunny
76e4be3bd5 fix 2023-04-29 00:36:36 +08:00
csunny
be498f323f add gradio 2023-04-29 00:33:14 +08:00
csunny
e5ffb6582c a demo 2023-04-28 23:53:29 +08:00
csunny
f73498b649 update 2023-04-28 22:48:39 +08:00
csunny
0861a09a00 init model and tokenizer 2023-04-28 22:18:08 +08:00
csunny
c72ae1a87f model: add model file 2023-04-28 22:04:37 +08:00
csunny
38f57e157c init 2023-04-28 21:59:18 +08:00
csunny
d308f0f5d8 add requirements 2023-04-28 18:05:24 +08:00