Commit Graph

182 Commits

Author SHA1 Message Date
FangYin Cheng
5dfe611478 feat(ChatKnowledge): Add custom text separators and refactor log configuration 2023-09-28 11:54:58 +08:00
yihong0618
76fdf52b0a fix: another way 2023-09-23 14:46:26 +08:00
yihong0618
24e6d16a09 fix: proxyllm do not need controller_addr 2023-09-22 16:47:34 +08:00
FangYin Cheng
28c24516a2 chore: Add _clear_model_cache function to clear model cache 2023-09-21 18:19:19 +08:00
FangYin Cheng
896af4e16f chore: fix shutdown error when not install torch 2023-09-21 12:20:24 +08:00
FangYin Cheng
33506b062b feat(core): Multi-module dependency splitting 2023-09-20 17:31:56 +08:00
FangYin Cheng
2d4d513eb5 chore: rename component 2023-09-19 10:23:39 +08:00
FangYin Cheng
ae34be23fd chore(model): new required field for supported models 2023-09-19 09:58:48 +08:00
FangYin Cheng
78553477a9 feat(model): new worker manager factory componet 2023-09-19 00:30:15 +08:00
FangYin Cheng
5aa9cb455e feat(model): support openai embedding model 2023-09-15 18:08:55 +08:00
FangYin Cheng
8da81486f5 fix(model): Fix remote embedding model error in some case 2023-09-14 20:11:41 +08:00
FangYin Cheng
f304f9709d fix(model): Fix the bug that the webserver cannot return model instances 2023-09-14 12:36:18 +08:00
FangYin Cheng
7b64c03d58 feat(model): support InternLM 2023-09-14 11:32:34 +08:00
FangYin Cheng
581cf361bf feat(model): multi-model supports embedding model and simple component design implementation 2023-09-13 12:14:21 +08:00
FangYin Cheng
27d7f9f6b9 chore: fix pylint 2023-09-11 17:28:22 +08:00
FangYin Cheng
986ada3aeb feat(model): supports the deployment of multiple models through the API and add the corresponding command line interface 2023-09-11 17:15:20 +08:00
FangYin Cheng
4744d2161d fix(model): fix proxy llm with fix model from CONFIG 2023-09-08 19:46:50 +08:00
FangYin Cheng
a8846c40aa feat(model): Unified Deployment Mode with multi-model and add command line chat with model 2023-09-08 17:52:48 +08:00
FangYin Cheng
b6a4fd8a62 feat: Multi-model support with proxyllm and add more command-cli 2023-09-05 11:26:24 +08:00
aries_ckt
858a1caefd fix:worker_register_host parameter does not work
Close #526
2023-09-03 18:14:51 +08:00
FangYin Cheng
e5bbd0bd86 feat: Command-line tool with knowledge repository initialization 2023-09-01 18:21:22 +08:00
FangYin Cheng
f19551a7cd feat: Optimize code import time 2023-09-01 10:40:18 +08:00
FangYin Cheng
e4dd6060da feat: Command-line tool design and multi-model integration 2023-08-31 17:22:31 +08:00
FangYin Cheng
dd86fb86b1 feat: Multi-model command line 2023-08-30 11:07:35 +08:00
FangYin Cheng
d467092766 merge multi-model and ChatExcel 2023-08-29 22:54:18 +08:00
csunny
e058511b4e pylint: lint code format 2023-08-23 17:02:54 +08:00
csunny
5f53463221 fix: gpt4all output bug 2023-08-23 16:47:59 +08:00
FangYin Cheng
efd17593ce fix: Fix alpaca prompt error 2023-08-18 17:18:01 +08:00
FangYin Cheng
909bb263a4 feat: Add examples and modify deploy documents 2023-08-18 15:12:37 +08:00
FangYin Cheng
b5fd5d2a3a feat: Support llama.cpp 2023-08-15 19:00:08 +08:00
csunny
743863d52b fix: set num_gpus reference for mps + cpu 2023-08-03 16:54:58 +08:00
csunny
d67a6a642a fix: num_gpus referenced error for mps + cpu 2023-08-03 16:52:39 +08:00
FangYin Cheng
a4574aa614 feat: Support vicuna-v1.5 and WizardLM-v1.2 2023-08-03 14:14:29 +08:00
FangYin Cheng
bceb609cf6 feat: Modify config for quantization and doc 2023-08-02 19:29:59 +08:00
FangYin Cheng
d8a4b776d5 feat: Support 8-bit quantization and 4-bit quantization for multi-gpu inference 2023-08-02 19:29:59 +08:00
xuyuan23
dea677004a fix: simply the code and optimization
simply the code and optimization
2023-07-31 19:19:39 +08:00
xuyuan23
1ff4cfdc42 feat: support bard proxy server
support bard proxy server

Close #384
2023-07-31 17:49:10 +08:00
magic.chen
9236f4260e llm proxy framework design, adding support for bard large language model proxy (#376)
1. llm proxy framework design, adding support for bard large language
model proxy
2. add Alibaba Cloud Image Deployment Solution.

Close #369
2023-07-28 17:04:09 +08:00
xuyuan23
4da524340c refactor: rename the data privacy module
rename data privace module.
2023-07-28 14:45:27 +08:00
xuyuan23
ca50e87b8f fix: support bard in chatdb
support bard proxy llm  in chatdb
2023-07-27 19:22:23 +08:00
xuyuan23
c4638bfde3 fix: fix function bard_generate_stream's output
fix function bard_generate_stream's output
2023-07-27 11:11:59 +08:00
xuyuan23
572c336b81 feat: Adjusting the proxy framework.
Adjusting the proxy framework, chatgpt_proxyllm default, or proxyllm instead, new LLM proxy should be configured in format 'xxx_proxyllm'.
2023-07-27 11:03:29 +08:00
xuyuan23
b1d84fb317 fix: fix bard LLM request param error
fix bard LLM request param error, use 'content' as the input
2023-07-26 17:02:48 +08:00
xuyuan23
d95726c04a feat: add Bard LLM proxy
Supplement proxy framework content, adding proxy access method for the Bard LLM.

Closes #369
2023-07-26 16:36:26 +08:00
FangYin Cheng
4b1c0a36f8 feat: Support baichuan-7B model 2023-07-25 22:08:07 +08:00
FangYin Cheng
7baaaf0849 feat: Support baichuan-13B model 2023-07-25 22:07:02 +08:00
FangYin Cheng
35d0c17ae8 feat: Support baichuan-7B model 2023-07-25 19:48:21 +08:00
FangYin Cheng
01074660bc feat: Support baichuan-13B model 2023-07-25 19:48:21 +08:00
FangYin Cheng
168c754a3f feat: Support llama-2 model 2023-07-20 21:44:40 +08:00
FangYin Cheng
d805e6ab42 feat: structured prompt data interaction between dbgpt-server and llm-server 2023-07-19 12:10:22 +08:00