1
0
mirror of https://github.com/imartinez/privateGPT.git synced 2025-05-08 00:06:39 +00:00

feat(docs): update doc for ipex-llm ()

This commit is contained in:
Shengsheng Huang 2024-07-08 15:42:44 +08:00 committed by GitHub
parent b687dc8524
commit 19a7c065ef
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -193,3 +193,9 @@ or
When the server is started it will print a log *Application startup complete*.
Navigate to http://localhost:8001 to use the Gradio UI or to http://localhost:8001/docs (API section) to try the API.
### Using IPEX-LLM
For a fully private setup on Intel GPUs (such as a local PC with an iGPU, or discrete GPUs like Arc, Flex, and Max), you can use [IPEX-LLM](https://github.com/intel-analytics/ipex-llm).
To deploy Ollama and pull models using IPEX-LLM, please refer to [this guide](https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/ollama_quickstart.html). Then, follow the same steps outlined in the [Using Ollama](#using-ollama) section to create a `settings-ollama.yaml` profile and run the private-GPT server.