mirror of
https://github.com/csunny/DB-GPT.git
synced 2025-08-01 00:03:29 +00:00
Merge branch 'llm_fxp' of https://github.com/csunny/DB-GPT into llm_fxp
This commit is contained in:
csunny
commit
9deae61e9d
19
README.md
19
README.md
@ -12,8 +12,6 @@
|
||||
[**简体中文**](README.zh.md)|[**Discord**](https://discord.gg/ea6BnZkY)
|
||||
</div>
|
||||
|
||||
[](https://star-history.com/#csunny/DB-GPT)
|
||||
|
||||
## What is DB-GPT?
|
||||
|
||||
As large models are released and iterated upon, they are becoming increasingly intelligent. However, in the process of using large models, we face significant challenges in data security and privacy. We need to ensure that our sensitive data and environments remain completely controlled and avoid any data privacy leaks or security risks. Based on this, we have launched the DB-GPT project to build a complete private large model solution for all database-based scenarios. This solution supports local deployment, allowing it to be applied not only in independent private environments but also to be independently deployed and isolated according to business modules, ensuring that the ability of large models is absolutely private, secure, and controllable.
|
||||
@ -53,7 +51,18 @@ Currently, we have released multiple key features, which are listed below to dem
|
||||
|
||||
## Demo
|
||||
|
||||
Run on an RTX 4090 GPU. [YouTube](https://www.youtube.com/watch?v=1PWI6F89LPo)
|
||||
Run on an RTX 4090 GPU.
|
||||
<p align="center">
|
||||
<img src="./assets/auto_sql_en.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/chaturl_en.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/new_knownledge_en.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
## Introduction
|
||||
DB-GPT creates a vast model operating system using [FastChat](https://github.com/lm-sys/FastChat) and offers a large language model powered by [Vicuna](https://huggingface.co/Tribbiani/vicuna-7b). In addition, we provide private domain knowledge base question-answering capability through LangChain. Furthermore, we also provide support for additional plugins, and our design natively supports the Auto-GPT plugin.
|
||||
@ -61,7 +70,7 @@ DB-GPT creates a vast model operating system using [FastChat](https://github.com
|
||||
Is the architecture of the entire DB-GPT shown in the following figure:
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/DB-GPT.png" width="600px" />
|
||||
<img src="./assets/DB-GPT.png" width="680px" />
|
||||
</p>
|
||||
|
||||
The core capabilities mainly consist of the following parts:
|
||||
@ -216,3 +225,5 @@ The MIT License (MIT)
|
||||
|
||||
## Contact Information
|
||||
We are working on building a community, if you have any ideas about building the community, feel free to contact us. [Discord](https://discord.gg/kMFf77FH)
|
||||
|
||||
[](https://star-history.com/#csunny/DB-GPT)
|
||||
|
||||
22
README.zh.md
22
README.zh.md
@ -12,8 +12,6 @@
|
||||
[**English**](README.md)|[**Discord**](https://discord.gg/ea6BnZkY)
|
||||
</div>
|
||||
|
||||
[](https://star-history.com/#csunny/DB-GPT)
|
||||
|
||||
## DB-GPT 是什么？
|
||||
|
||||
随着大模型的发布迭代，大模型变得越来越智能，在使用大模型的过程当中，遇到极大的数据安全与隐私挑战。在利用大模型能力的过程中我们的私密数据跟环境需要掌握自己的手里，完全可控，避免任何的数据隐私泄露以及安全风险。基于此，我们发起了DB-GPT项目，为所有以数据库为基础的场景，构建一套完整的私有大模型解决方案。 此方案因为支持本地部署，所以不仅仅可以应用于独立私有环境，而且还可以根据业务模块独立部署隔离，让大模型的能力绝对私有、安全、可控。
|
||||
@ -51,7 +49,22 @@ DB-GPT 是一个开源的以数据库为基础的GPT实验项目，使用本地
|
||||
|
||||
## 效果演示
|
||||
|
||||
示例通过 RTX 4090 GPU 演示，[YouTube 地址](https://www.youtube.com/watch?v=1PWI6F89LPo)
|
||||
示例通过 RTX 4090 GPU 演示
|
||||
<p align="center">
|
||||
<img src="./assets/演示.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/auto_sql.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/chat_url_zh.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
<p align="center">
|
||||
<img src="./assets/new_knownledge.gif" width="680px" />
|
||||
</p>
|
||||
|
||||
## 架构方案
|
||||
DB-GPT基于 [FastChat](https://github.com/lm-sys/FastChat) 构建大模型运行环境，并提供 vicuna 作为基础的大语言模型。此外，我们通过LangChain提供私域知识库问答能力。同时我们支持插件模式, 在设计上原生支持Auto-GPT插件。
|
||||
@ -220,3 +233,6 @@ Run the Python interpreter and type the commands:
|
||||
## Licence
|
||||
|
||||
The MIT License (MIT)
|
||||
|
||||
[](https://star-history.com/#csunny/DB-GPT)
|
||||
|
||||
|
||||
@ -44,13 +44,13 @@ lang_dicts = {
|
||||
"learn_more_markdown": "The service is a research preview intended for non-commercial use only. subject to the model [License](https://github.com/facebookresearch/llama/blob/main/MODEL_CARD.md) of Vicuna-13B",
|
||||
"model_control_param": "Model Parameters",
|
||||
"sql_generate_mode_direct": "Execute directly",
|
||||
"sql_generate_mode_none": "Execute without model",
|
||||
"sql_generate_mode_none": "Execute without mode",
|
||||
"max_input_token_size": "Maximum output token size",
|
||||
"please_choose_database": "Please choose database",
|
||||
"sql_generate_diagnostics": "SQL Generation & Diagnostics",
|
||||
"knowledge_qa_type_llm_native_dialogue": "LLM native dialogue",
|
||||
"knowledge_qa_type_default_knowledge_base_dialogue": "Default documents",
|
||||
"knowledge_qa_type_add_knowledge_base_dialogue": "Added documents",
|
||||
"knowledge_qa_type_add_knowledge_base_dialogue": "New documents",
|
||||
"knowledge_qa_type_url_knowledge_dialogue": "Chat with url",
|
||||
"dialogue_use_plugin": "Dialogue Extension",
|
||||
"create_knowledge_base": "Create Knowledge Base",
|
||||
@ -60,7 +60,7 @@ lang_dicts = {
|
||||
"sql_vs_setting": "In the automatic execution mode, DB-GPT can have the ability to execute SQL, read data from the network, automatically store and learn",
|
||||
"chat_use_plugin": "Plugin Mode",
|
||||
"select_plugin": "Select Plugin",
|
||||
"knowledge_qa": "Documents QA",
|
||||
"knowledge_qa": "Documents Chat",
|
||||
"configure_knowledge_base": "Configure Documents",
|
||||
"url_input_label": "Please input url",
|
||||
"new_klg_name": "New document name",
|
||||
|
||||
@ -402,58 +402,6 @@ def build_single_model_ui():
|
||||
tabs.select(on_select, None, selected)
|
||||
|
||||
with tabs:
|
||||
tab_sql = gr.TabItem(get_lang_text("sql_generate_diagnostics"), elem_id="SQL")
|
||||
with tab_sql:
|
||||
# TODO A selector to choose database
|
||||
with gr.Row(elem_id="db_selector"):
|
||||
db_selector = gr.Dropdown(
|
||||
label=get_lang_text("please_choose_database"),
|
||||
choices=dbs,
|
||||
value=dbs[0] if len(models) > 0 else "",
|
||||
interactive=True,
|
||||
show_label=True,
|
||||
).style(container=False)
|
||||
|
||||
db_selector.change(fn=db_selector_changed, inputs=db_selector)
|
||||
|
||||
sql_mode = gr.Radio(
|
||||
[
|
||||
get_lang_text("sql_generate_mode_direct"),
|
||||
get_lang_text("sql_generate_mode_none"),
|
||||
],
|
||||
show_label=False,
|
||||
value=get_lang_text("sql_generate_mode_none"),
|
||||
)
|
||||
sql_vs_setting = gr.Markdown(get_lang_text("sql_vs_setting"))
|
||||
sql_mode.change(fn=change_sql_mode, inputs=sql_mode, outputs=sql_vs_setting)
|
||||
|
||||
tab_plugin = gr.TabItem(get_lang_text("chat_use_plugin"), elem_id="PLUGIN")
|
||||
# tab_plugin.select(change_func)
|
||||
with tab_plugin:
|
||||
print("tab_plugin in...")
|
||||
with gr.Row(elem_id="plugin_selector"):
|
||||
# TODO
|
||||
plugin_selector = gr.Dropdown(
|
||||
label=get_lang_text("select_plugin"),
|
||||
choices=list(plugins_select_info().keys()),
|
||||
value="",
|
||||
interactive=True,
|
||||
show_label=True,
|
||||
type="value",
|
||||
).style(container=False)
|
||||
|
||||
def plugin_change(
|
||||
evt: gr.SelectData,
|
||||
): # SelectData is a subclass of EventData
|
||||
print(f"You selected {evt.value} at {evt.index} from {evt.target}")
|
||||
print(f"user plugin:{plugins_select_info().get(evt.value)}")
|
||||
return plugins_select_info().get(evt.value)
|
||||
|
||||
plugin_selected = gr.Textbox(
|
||||
show_label=False, visible=False, placeholder="Selected"
|
||||
)
|
||||
plugin_selector.select(plugin_change, None, plugin_selected)
|
||||
|
||||
tab_qa = gr.TabItem(get_lang_text("knowledge_qa"), elem_id="QA")
|
||||
with tab_qa:
|
||||
mode = gr.Radio(
|
||||
@ -516,6 +464,59 @@ def build_single_model_ui():
|
||||
get_lang_text("upload_and_load_to_klg")
|
||||
)
|
||||
|
||||
tab_sql = gr.TabItem(get_lang_text("sql_generate_diagnostics"), elem_id="SQL")
|
||||
with tab_sql:
|
||||
# TODO A selector to choose database
|
||||
with gr.Row(elem_id="db_selector"):
|
||||
db_selector = gr.Dropdown(
|
||||
label=get_lang_text("please_choose_database"),
|
||||
choices=dbs,
|
||||
value=dbs[0] if len(models) > 0 else "",
|
||||
interactive=True,
|
||||
show_label=True,
|
||||
).style(container=False)
|
||||
|
||||
db_selector.change(fn=db_selector_changed, inputs=db_selector)
|
||||
|
||||
sql_mode = gr.Radio(
|
||||
[
|
||||
get_lang_text("sql_generate_mode_direct"),
|
||||
get_lang_text("sql_generate_mode_none"),
|
||||
],
|
||||
show_label=False,
|
||||
value=get_lang_text("sql_generate_mode_none"),
|
||||
)
|
||||
sql_vs_setting = gr.Markdown(get_lang_text("sql_vs_setting"))
|
||||
sql_mode.change(fn=change_sql_mode, inputs=sql_mode, outputs=sql_vs_setting)
|
||||
|
||||
tab_plugin = gr.TabItem(get_lang_text("chat_use_plugin"), elem_id="PLUGIN")
|
||||
# tab_plugin.select(change_func)
|
||||
with tab_plugin:
|
||||
print("tab_plugin in...")
|
||||
with gr.Row(elem_id="plugin_selector"):
|
||||
# TODO
|
||||
plugin_selector = gr.Dropdown(
|
||||
label=get_lang_text("select_plugin"),
|
||||
choices=list(plugins_select_info().keys()),
|
||||
value="",
|
||||
interactive=True,
|
||||
show_label=True,
|
||||
type="value",
|
||||
).style(container=False)
|
||||
|
||||
def plugin_change(
|
||||
evt: gr.SelectData,
|
||||
): # SelectData is a subclass of EventData
|
||||
print(f"You selected {evt.value} at {evt.index} from {evt.target}")
|
||||
print(f"user plugin:{plugins_select_info().get(evt.value)}")
|
||||
return plugins_select_info().get(evt.value)
|
||||
|
||||
plugin_selected = gr.Textbox(
|
||||
show_label=False, visible=False, placeholder="Selected"
|
||||
)
|
||||
plugin_selector.select(plugin_change, None, plugin_selected)
|
||||
|
||||
|
||||
with gr.Blocks():
|
||||
chatbot = grChatbot(elem_id="chatbot", visible=False).style(height=550)
|
||||
with gr.Row():
|
||||
|
||||
Loading…
Reference in New Issue
Block a user