doc:llm usage

This commit is contained in:
aries_ckt
2023-08-17 13:20:36 +08:00
parent 5a07a6b9d1
commit b34b8cd883
13 changed files with 93 additions and 70 deletions

View File

@@ -0,0 +1,2 @@
llama.cpp
==================================

View File

@@ -0,0 +1,18 @@
LLM Usage
==================================
DB-GPT provides a management and deployment solution for multiple models. This chapter mainly discusses how to deploy different models.
.. image:: ./assets/llm/dbgpt_llm.jpg
- llama_cpp
- quantization
.. toctree::
:maxdepth: 2
:caption: LLM Usage
:name: llama_cpp
:hidden:
./llama/llama_cpp.md
./quantization/quantization.md

View File

@@ -0,0 +1,2 @@
quantization
==================================