env param doc bugfix

This commit is contained in:
oushu1zhangxiangxuan1
2023-10-12 11:21:58 +08:00
committed by JohnSaxon
parent 2fe8ca451e
commit 4806e16d5f

View File

@@ -6,7 +6,9 @@ LLM Model Name, see /pilot/configs/model_config.LLM_MODEL_CONFIG
* LLM_MODEL=vicuna-13b * LLM_MODEL=vicuna-13b
MODEL_SERVER_ADDRESS MODEL_SERVER_ADDRESS
* MODEL_SERVER=http://127.0.0.1:8000 * MODEL_SERVER=http://127.0.0.1:8000
LIMIT_MODEL_CONCURRENCY LIMIT_MODEL_CONCURRENCY
* LIMIT_MODEL_CONCURRENCY=5 * LIMIT_MODEL_CONCURRENCY=5
@@ -84,21 +86,6 @@ embedding recall max token ,2000
* WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network * WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network
``` ```
```{admonition} Vector Store SETTINGS
#### Chroma
* VECTOR_STORE_TYPE=Chroma
#### MILVUS
* VECTOR_STORE_TYPE=Milvus
* MILVUS_URL=127.0.0.1
* MILVUS_PORT=19530
* MILVUS_USERNAME
* MILVUS_PASSWORD
* MILVUS_SECURE=
#### WEAVIATE
* WEAVIATE_URL=https://kt-region-m8hcy0wc.weaviate.network
```
```{admonition} Multi-GPU Setting ```{admonition} Multi-GPU Setting
See https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/ See https://developer.nvidia.com/blog/cuda-pro-tip-control-gpu-visibility-cuda_visible_devices/
If CUDA_VISIBLE_DEVICES is not configured, all available gpus will be used If CUDA_VISIBLE_DEVICES is not configured, all available gpus will be used