github/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2025-09-03 09:34:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

backend: do not use Vulkan with non-LLaMA models

Browse Source
This commit is contained in:
Cebtenzzre
2023-10-04 16:21:30 -04:00
committed by Adam Treat
parent 672cb850f9
commit 1534df3e9f
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
gpt4all-chat/chatllm.cpp
View File

@@ -309,8 +309,7 @@ bool ChatLLM::loadModel(const ModelInfo &modelInfo)
// We might have had to fallback to CPU after load if the model is not possible to accelerate // We might have had to fallback to CPU after load if the model is not possible to accelerate
// for instance if the quantization method is not supported on Vulkan yet // for instance if the quantization method is not supported on Vulkan yet
emit reportDevice("CPU"); emit reportDevice("CPU");
// TODO(cebtenzzre): report somewhere if llamamodel decided the model was not supported emit reportFallbackReason("<br>Using CPU: unsupported model or quant");
emit reportFallbackReason("<br>Using CPU: unsupported quantization type");
} }
MySettings::globalInstance()->setAttemptModelLoad(QString()); MySettings::globalInstance()->setAttemptModelLoad(QString());