DB-GPT: Revolutionizing Database Interactions with Private LLM Technology

简体中文 |Discord |Documents|Wechat|Community

What is DB-GPT?

DB-GPT is an experimental open-source project that uses localized GPT large models to interact with your data and environment. With this solution, you can be assured that there is no risk of data leakage, and your data is 100% private and secure.

Contents

• install
• demo
• introduction
• features
• contribution
• roadmap
• contract

DB-GPT Youtube Video

Demo

Run on an RTX 4090 GPU.

Chat with data, and figure charts.

Features

Currently, we have released multiple key features, which are listed below to demonstrate our current capabilities:

• SQL language capabilities

  • SQL generation
  • SQL diagnosis

• Private domain Q&A and data processing

  • Knowledge Management(We currently support many document formats: txt, pdf, md, html, doc, ppt, and url.)

• ChatDB

• ChatExcel

• ChatDashboard

• Multi-Agents&Plugins

• Unified vector storage/indexing of knowledge base

  • Support for unstructured data such as PDF, TXT, Markdown, CSV, DOC, PPT, and WebURL

• Multi LLMs Support, Supports multiple large language models, currently supporting

  • 🔥 InternLM(7b,20b)
  • 🔥 Baichuan2(7b,13b)
  • 🔥 Vicuna-v1.5(7b,13b)
  • 🔥 llama-2(7b,13b,70b)
  • WizardLM-v1.2(13b)
  • Vicuna (7b,13b)
  • ChatGLM-6b (int4,int8)
  • ChatGLM2-6b (int4,int8)
  • guanaco(7b,13b,33b)
  • Gorilla(7b,13b)
  • baichuan(7b,13b)

• Support API Proxy LLMs

  • ChatGPT
  • Tongyi
  • Wenxin
  • Spark
  • MiniMax
  • ChatGLM

Introduction

DB-GPT creates a vast model operating system using FastChat and offers a large language model powered by vicuna. In addition, we provide private domain knowledge base question-answering capability. Furthermore, we also provide support for additional plugins, and our design natively supports the Auto-GPT plugin.Our vision is to make it easier and more convenient to build applications around databases and llm.

Is the architecture of the entire DB-GPT shown in the following figure:

The core capabilities mainly consist of the following parts:

1. Knowledge base capability: Supports private domain knowledge base question-answering capability.
2. Large-scale model management capability: Provides a large model operating environment based on FastChat.
3. Unified data vector storage and indexing: Provides a uniform way to store and index various data types.
4. Connection module: Used to connect different modules and data sources to achieve data flow and interaction.
5. Agent and plugins: Provides Agent and plugin mechanisms, allowing users to customize and enhance the system's behavior.
6. Prompt generation and optimization: Automatically generates high-quality prompts and optimizes them to improve system response efficiency.
7. Multi-platform product interface: Supports various client products, such as web, mobile applications, and desktop applications.

SubModule

• DB-GPT-Hub Text-to-SQL parsing with LLMs
• DB-GPT-Plugins DB-GPT Plugins, Can run autogpt plugin directly
• DB-GPT-Web ChatUI for DB-GPT

Image

🌐 AutoDL Image

Install

Quickstart

Language Switching

In the .env configuration file, modify the LANGUAGE parameter to switch to different languages. The default is English (Chinese: zh, English: en, other languages to be added later).

Contribution

• Please run black . before submitting the code. contributing guidelines, how to contribution

RoadMap

KBQA RAG optimization

• [] KnownledgeGraph

Multi Datasource Support

DataSource	support	Notes
MySQL	Yes
PostgresSQL	Yes
Spark	Yes
DuckDB	Yes
Sqlite	Yes
MSSQL	Yes
ClickHouse	Yes
Oracle	No	TODO
Redis	No	TODO
MongoDB	No	TODO
HBase	No	TODO
Doris	No	TODO
DB2	No	TODO
Couchbase	No	TODO
Elasticsearch	No	TODO
OceanBase	No	TODO
TiDB	No	TODO
StarRocks	No	TODO

Multi-Models And vLLM

• meta-llama/Llama-2-7b-chat-hf
• baichuan2-7b/baichuan2-13b
• internlm/internlm-chat-7b
• Qwen/Qwen-7B-Chat/Qwen-14B-Chat
• Vicuna
• BlinkDL/RWKV-4-Raven
• camel-ai/CAMEL-13B-Combined-Data
• databricks/dolly-v2-12b
• FreedomIntelligence/phoenix-inst-chat-7b
• h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b
• lcw99/polyglot-ko-12.8b-chang-instruct-chat
• lmsys/fastchat-t5-3b-v1.0
• mosaicml/mpt-7b-chat
• Neutralzz/BiLLa-7B-SFT
• nomic-ai/gpt4all-13b-snoozy
• NousResearch/Nous-Hermes-13b
• openaccess-ai-collective/manticore-13b-chat-pyg
• OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5
• project-baize/baize-v2-7b
• Salesforce/codet5p-6b
• StabilityAI/stablelm-tuned-alpha-7b
• THUDM/chatglm-6b
• THUDM/chatglm2-6b
• tiiuae/falcon-40b
• timdettmers/guanaco-33b-merged
• togethercomputer/RedPajama-INCITE-7B-Chat
• WizardLM/WizardLM-13B-V1.0
• WizardLM/WizardCoder-15B-V1.0
• baichuan-inc/baichuan-7B
• HuggingFaceH4/starchat-beta
• FlagAlpha/Llama2-Chinese-13b-Chat
• BAAI/AquilaChat-7B
• all models of OpenOrca
• Spicyboros + airoboros 2.2
• VMware's OpenLLaMa OpenInstruct

Agents market and Plugins

• multi-agents framework
• custom plugin development
• plugin market

Text2SQL Finetune

LLMs	Size	Module	Template
LLaMA	7B/13B/33B/65B	q_proj,v_proj	-
LLaMA-2	7B/13B/70B	q_proj,v_proj	llama2
BLOOM	560M/1.1B/1.7B/3B/7.1B/176B	query_key_value	-
BLOOMZ	560M/1.1B/1.7B/3B/7.1B/176B	query_key_value	-
Falcon	7B/40B	query_key_value	-
Baichuan	7B/13B	W_pack	baichuan
Baichuan2	7B/13B	W_pack	baichuan2
InternLM	7B	q_proj,v_proj	intern
Qwen	7B	c_attn	chatml
XVERSE	13B	q_proj,v_proj	xverse
ChatGLM2	6B	query_key_value	chatglm2

Datasets

Datasets	License	Link
academic	Not Found	https://github.com/jkkummerfeld/text2sql-data
advising	CC-BY-4.0	https://github.com/jkkummerfeld/text2sql-data
atis	Not Found	https://github.com/jkkummerfeld/text2sql-data
restaurants	Not Found	https://github.com/jkkummerfeld/text2sql-data
scholar	Not Found	https://github.com/jkkummerfeld/text2sql-data
imdb	Not Found	https://github.com/jkkummerfeld/text2sql-data
yelp	Not Found	https://github.com/jkkummerfeld/text2sql-data
criteria2sql	Apache-2.0	https://github.com/xiaojingyu92/Criteria2SQL
css	CC-BY-4.0	https://huggingface.co/datasets/zhanghanchong/css
eICU	CC-BY-4.0	https://github.com/glee4810/EHRSQL
mimic_iii	CC-BY-4.0	https://github.com/glee4810/EHRSQL
geonucleardata	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
greatermanchestercrime	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
studentmathscore	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
thehistoryofbaseball	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
uswildfires	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
whatcdhiphop	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
worldsoccerdatabase	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
pesticide	CC-BY-SA-4.0	https://github.com/chiahsuan156/KaggleDBQA
mimicsql_data	MIT	https://github.com/wangpinggl/TREQS
nvbench	MIT	https://github.com/TsinghuaDatabaseGroup/nvBench
sede	Apache-2.0	https://github.com/hirupert/sede
spider	CC-BY-SA-4.0	https://huggingface.co/datasets/spider
sql_create_context	CC-BY-4.0	https://huggingface.co/datasets/b-mc2/sql-create-context
squall	CC-BY-SA-4.0	https://github.com/tzshi/squall
wikisql	BSD 3-Clause	https://github.com/salesforce/WikiSQL
BIRD	Not Found	https://bird-bench.github.io/
CHASE	MIT LICENSE	https://xjtu-intsoft.github.io/chase/
cosql	Not Found	https://yale-lily.github.io/cosql/

More Information about Text2SQL finetune

Licence

The MIT License (MIT)

Contact Information

We are working on building a community, if you have any ideas about building the community, feel free to contact us.