github/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2025-07-06 12:06:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix: config for index building

Browse Source
This commit is contained in:
Zach Nussbaum 2023-05-01 21:39:55 +00:00
parent 0f61cd8b42
commit 00f04360d2
1 changed files with 13 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
configs/index/finetune_gptjr.yaml Normal file
View File

@ -0,0 +1,13 @@
# dataset
streaming: false
num_proc: 64
dataset_path: "squad"
max_length: 1024
batch_size: 32
#index
index_path: "/home/paperspace/gpt4all/gpt4all/index/wiki-cohere-index.bin"
index_database: "nomic-ai/cohere-wiki-sbert"
index_space: "cosine"
index_dim: 384
query_embedding_field: 'question'