github/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2025-09-06 11:00:48 +00:00
Code Issues Packages Projects Releases Wiki Activity

backend: dedupe tokenizing code in mpt/gptj

Browse Source
This commit is contained in:
Aaron Miller
2023-05-15 17:42:20 -07:00
committed by AT
parent 6182026c70
commit d14936bfd6
4 changed files with 6 additions and 102 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
gpt4all-backend/gptj.cpp
View File

@@ -983,7 +983,7 @@ void GPTJ::prompt(const std::string &prompt,
gpt_vocab::id id = 0;
{
const int64_t t_start_sample_us = ggml_time_us();
id = gpt_sample_top_k_top_p(d_ptr->vocab,
id = gpt_sample_top_k_top_p(d_ptr->vocab, n_vocab,
promptCtx.tokens.data() + promptCtx.n_ctx - promptCtx.n_ctx,
promptCtx.n_ctx,
promptCtx.logits,