LLM Usage
==================================
DB-GPT provides a management and deployment solution for multiple models. This chapter mainly discusses how to deploy different models.

.. image:: https://github.com/eosphoros-ai/DB-GPT/assets/13723926/a0d0840f-570a-4409-bb7d-bec6535a5f62


Multi LLMs Support, Supports multiple large language models, currently supporting
  - 🔥 InternLM(7b,20b)
  - 🔥 Baichuan2(7b,13b)
  - 🔥 Vicuna-v1.5(7b,13b)
  - 🔥 llama-2(7b,13b,70b)
  - WizardLM-v1.2(13b)
  - Vicuna (7b,13b)
  - ChatGLM-6b (int4,int8)
  - ChatGLM2-6b (int4,int8)
  - guanaco(7b,13b,33b)
  - Gorilla(7b,13b)
  - Baichuan(7b,13b)
  - OpenAI

- llama_cpp
- quantization

.. toctree::
   :maxdepth: 2
   :caption: LLM Usage
   :name: llama_cpp
   :hidden:

   ./proxyllm/proxyllm.md
   ./llama/llama_cpp.md
   ./quantization/quantization.md
   ./vllm/vllm.md