github/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2025-09-06 11:00:48 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix up for newer models on reset context. This fixes the model from totally failing after a reset context.

Browse Source
This commit is contained in:
Adam Treat
2023-06-04 19:31:00 -04:00
parent bdba2e8de6
commit 301d2fdbea
9 changed files with 11 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
gpt4all-backend/llmodel_shared.cpp
View File

@@ -38,7 +38,7 @@ void LLModel::prompt(const std::string &prompt,
}
// tokenize the prompt
std::vector<Token> embd_inp = tokenize(prompt);
std::vector<Token> embd_inp = tokenize(promptCtx, prompt);
// save the context size
promptCtx.n_ctx = contextLength();