mirror of
https://github.com/csunny/DB-GPT.git
synced 2025-09-29 05:18:47 +00:00
35 lines
870 B
ReStructuredText
35 lines
870 B
ReStructuredText
LLM Usage
|
|
==================================
|
|
DB-GPT provides a management and deployment solution for multiple models. This chapter mainly discusses how to deploy different models.
|
|
|
|
.. image:: https://github.com/eosphoros-ai/DB-GPT/assets/13723926/a0d0840f-570a-4409-bb7d-bec6535a5f62
|
|
|
|
|
|
Multi LLMs Support, Supports multiple large language models, currently supporting
|
|
- 🔥 InternLM(7b,20b)
|
|
- 🔥 Baichuan2(7b,13b)
|
|
- 🔥 Vicuna-v1.5(7b,13b)
|
|
- 🔥 llama-2(7b,13b,70b)
|
|
- WizardLM-v1.2(13b)
|
|
- Vicuna (7b,13b)
|
|
- ChatGLM-6b (int4,int8)
|
|
- ChatGLM2-6b (int4,int8)
|
|
- guanaco(7b,13b,33b)
|
|
- Gorilla(7b,13b)
|
|
- Baichuan(7b,13b)
|
|
- OpenAI
|
|
|
|
- llama_cpp
|
|
- quantization
|
|
|
|
.. toctree::
|
|
:maxdepth: 2
|
|
:caption: LLM Usage
|
|
:name: llama_cpp
|
|
:hidden:
|
|
|
|
./proxyllm/proxyllm.md
|
|
./llama/llama_cpp.md
|
|
./quantization/quantization.md
|
|
./vllm/vllm.md
|