Files
privateGPT/settings-sagemaker.yaml
Iván Martínez ad512e3c42 Feature/sagemaker embedding (#1161)
* Sagemaker deployed embedding model support

---------

Co-authored-by: Pablo Orgaz <pabloogc@gmail.com>
2023-11-05 16:16:49 +01:00

14 lines
283 B
YAML

server:
env_name: ${APP_ENV:prod}
port: ${PORT:8001}
ui:
enabled: true
path: /
llm:
mode: sagemaker
sagemaker:
llm_endpoint_name: huggingface-pytorch-tgi-inference-2023-09-25-19-53-32-140
embedding_endpoint_name: huggingface-pytorch-inference-2023-11-03-07-41-36-479