Files
DB-GPT/docs/getting_started/application/model/model.md
2023-10-17 19:46:34 +08:00

4.3 KiB

Model Management

model DB-GPT Product Provides LLM Model Management in web interface.Including LLM Create, Start and Stop. Now DB-GPT support LLMs:

* Multi LLMs Support, Supports multiple large language models, currently supporting
  * [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf)
  * [baichuan2-7b/baichuan2-13b](https://huggingface.co/baichuan-inc)
  * [internlm/internlm-chat-7b](https://huggingface.co/internlm/internlm-chat-7b)
  * [Qwen/Qwen-7B-Chat/Qwen-14B-Chat](https://huggingface.co/Qwen/)
  * [Vicuna](https://huggingface.co/Tribbiani/vicuna-13b)
  * [BlinkDL/RWKV-4-Raven](https://huggingface.co/BlinkDL/rwkv-4-raven)
  * [camel-ai/CAMEL-13B-Combined-Data](https://huggingface.co/camel-ai/CAMEL-13B-Combined-Data)
  * [databricks/dolly-v2-12b](https://huggingface.co/databricks/dolly-v2-12b)
  * [FreedomIntelligence/phoenix-inst-chat-7b](https://huggingface.co/FreedomIntelligence/phoenix-inst-chat-7b)
  * [h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b](https://huggingface.co/h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b)
  * [lcw99/polyglot-ko-12.8b-chang-instruct-chat](https://huggingface.co/lcw99/polyglot-ko-12.8b-chang-instruct-chat)
  * [lmsys/fastchat-t5-3b-v1.0](https://huggingface.co/lmsys/fastchat-t5)
  * [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat)
  * [Neutralzz/BiLLa-7B-SFT](https://huggingface.co/Neutralzz/BiLLa-7B-SFT)
  * [nomic-ai/gpt4all-13b-snoozy](https://huggingface.co/nomic-ai/gpt4all-13b-snoozy)
  * [NousResearch/Nous-Hermes-13b](https://huggingface.co/NousResearch/Nous-Hermes-13b)
  * [openaccess-ai-collective/manticore-13b-chat-pyg](https://huggingface.co/openaccess-ai-collective/manticore-13b-chat-pyg)
  * [OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5](https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5)
  * [project-baize/baize-v2-7b](https://huggingface.co/project-baize/baize-v2-7b)
  * [Salesforce/codet5p-6b](https://huggingface.co/Salesforce/codet5p-6b)
  * [StabilityAI/stablelm-tuned-alpha-7b](https://huggingface.co/stabilityai/stablelm-tuned-alpha-7b)
  * [THUDM/chatglm-6b](https://huggingface.co/THUDM/chatglm-6b)
  * [THUDM/chatglm2-6b](https://huggingface.co/THUDM/chatglm2-6b)
  * [tiiuae/falcon-40b](https://huggingface.co/tiiuae/falcon-40b)
  * [timdettmers/guanaco-33b-merged](https://huggingface.co/timdettmers/guanaco-33b-merged)
  * [togethercomputer/RedPajama-INCITE-7B-Chat](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat)
  * [WizardLM/WizardLM-13B-V1.0](https://huggingface.co/WizardLM/WizardLM-13B-V1.0)
  * [WizardLM/WizardCoder-15B-V1.0](https://huggingface.co/WizardLM/WizardCoder-15B-V1.0)
  * [baichuan-inc/baichuan-7B](https://huggingface.co/baichuan-inc/baichuan-7B)
  * [HuggingFaceH4/starchat-beta](https://huggingface.co/HuggingFaceH4/starchat-beta)
  * [FlagAlpha/Llama2-Chinese-13b-Chat](https://huggingface.co/FlagAlpha/Llama2-Chinese-13b-Chat)
  * [BAAI/AquilaChat-7B](https://huggingface.co/BAAI/AquilaChat-7B)
  * [all models of OpenOrca](https://huggingface.co/Open-Orca)
  * [Spicyboros](https://huggingface.co/jondurbin/spicyboros-7b-2.2?not-for-all-audiences=true) + [airoboros 2.2](https://huggingface.co/jondurbin/airoboros-l2-13b-2.2)
  * [VMware's OpenLLaMa OpenInstruct](https://huggingface.co/VMware/open-llama-7b-open-instruct)

* Support API Proxy LLMs
  * [ChatGPT](https://api.openai.com/)
  * [Tongyi](https://www.aliyun.com/product/dashscope)
  * [Wenxin](https://cloud.baidu.com/product/wenxinworkshop?track=dingbutonglan)
  * [ChatGLM](http://open.bigmodel.cn/)

Create && Start LLM Model

Make sure your LLM Model file is downloaded or LLM Model Proxy api service is ready. 

model-start When create success, you can see: image Then you can choose and switch llm model service to chat. image

Stop LLM Model

image