github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-07-01 17:52:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

Updated Docs Llama-CPP Linux NVIDIA GPU support and Windows-WSL

Browse Source
This commit is contained in:
Gaurav Shukla 2025-05-02 21:42:26 +05:30
parent b7ee43788d
commit f0dfdc28cc
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
fern/docs/pages/installation/installation.mdx
View File

@ -340,7 +340,7 @@ Some tips:
After that running the following command in the repository will install llama.cpp with GPU support:
```bash
CMAKE_ARGS='-DLLAMA_CUBLAS=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python numpy==1.26.0
CMAKE_ARGS='-DGGML_CUDA=on' poetry run pip install --force-reinstall --no-cache-dir llama-cpp-python==0.2.90 numpy==1.26.4 markupsafe==2.1.5
```
If your installation was correct, you should see a message similar to the following next