github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-07-13 15:14:09 +00:00
Code Issues Packages Projects Releases Wiki Activity

update readme

Browse Source
This commit is contained in:
Yevhenii Semendiak 2024-04-29 16:09:17 +03:00
parent 02e9b0e818
commit 659e0f1a9d
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -11,8 +11,9 @@ Note: this setup is mostly for POC purposes. For production-ready setup, you'll
5. `neuro-flow run vllm` -- start LLM inference server. Note: if you want to change LLM hosted there, change it in bash command and in `env.VLLM_MODEL` of `pgpt` job. 5. `neuro-flow run vllm` -- start LLM inference server. Note: if you want to change LLM hosted there, change it in bash command and in `env.VLLM_MODEL` of `pgpt` job.
6. `neuro-flow run pgpt` -- start PrivateGPT web server. 6. `neuro-flow run pgpt` -- start PrivateGPT web server.
### Running PrivateGPT as stand-alone job
<details> <details>
<summary>Running PrivateGPT as stand-alone job</summary> <summary> Instruction </summary>
Currently, we support only deployment case with vLLM as LLM inference server, PGVector as a vector store and Ollama as embeddings server. Currently, we support only deployment case with vLLM as LLM inference server, PGVector as a vector store and Ollama as embeddings server.