mirror of
https://github.com/csunny/DB-GPT.git
synced 2025-09-12 12:37:14 +00:00
env param doc bugfix
This commit is contained in:
committed by
JohnSaxon
parent
2fe8ca451e
commit
4806e16d5f
@@ -6,7 +6,9 @@ LLM Model Name, see /pilot/configs/model_config.LLM_MODEL_CONFIG
|
|||||||
* LLM_MODEL=vicuna-13b
|
* LLM_MODEL=vicuna-13b
|
||||||
|
|
||||||
MODEL_SERVER_ADDRESS
|
MODEL_SERVER_ADDRESS
|
||||||
|
|
||||||
* MODEL_SERVER=http://127.0.0.1:8000
|
* MODEL_SERVER=http://127.0.0.1:8000
|
||||||
|
|
||||||
LIMIT_MODEL_CONCURRENCY
|
LIMIT_MODEL_CONCURRENCY
|
||||||
|
|
||||||
* LIMIT_MODEL_CONCURRENCY=5
|
* LIMIT_MODEL_CONCURRENCY=5
|
||||||
@@ -84,21 +86,6 @@ embedding recall max token ,2000
|
|||||||
* WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network
|
* WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network
|
||||||
```
|
```
|
||||||
|
|
||||||
```{admonition} Vector Store SETTINGS
|
|
||||||
#### Chroma
|
|
||||||
* VECTOR_STORE_TYPE=Chroma
|
|
||||||
#### MILVUS
|
|
||||||
* VECTOR_STORE_TYPE=Milvus
|
|
||||||
* MILVUS_URL=127.0.0.1
|
|
||||||
* MILVUS_PORT=19530
|
|
||||||
* MILVUS_USERNAME
|
|
||||||
* MILVUS_PASSWORD
|
|
||||||
* MILVUS_SECURE=
|
|
||||||
|
|
||||||
#### WEAVIATE
|
|
||||||
* WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network
|
|
||||||
```
|
|
||||||
|
|
||||||
```{admonition} Multi-GPU Setting
|
```{admonition} Multi-GPU Setting
|
||||||
See https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/
|
See https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/
|
||||||
If CUDA_VISIBLE_DEVICES is not configured, all available gpus will be used
|
If CUDA_VISIBLE_DEVICES is not configured, all available gpus will be used
|
||||||
|
Reference in New Issue
Block a user