github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-06-25 06:52:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

Adding working combination of LLM and Embedding Model to recipes (#1315)

Browse Source 
Co-authored-by: ishaandatta <ishaandatta50@gmail.com>
This commit is contained in:
ishaandatta 2023-11-30 01:24:22 +05:30 committed by GitHub
parent aabdb046ae
commit 28d03fdda8
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 11 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

11
fern/docs/pages/recipes/list-llm.mdx
View File

@ -82,3 +82,14 @@ Situation: tu es au milieu d'un champ.
Tache: va a la rivière, en bas du champ.
Décrit comment aller a la rivière.
```
### Optimised Models
GodziLLa2-70B LLM (English, rank 2 on HuggingFace OpenLLM Leaderboard), bge large Embedding Model (rank 1 on HuggingFace MTEB Leaderboard)
`settings-optimised.yaml`:
```yml
local:
llm_hf_repo_id: TheBloke/GodziLLa2-70B-GGUF
llm_hf_model_file: godzilla2-70b.Q4_K_M.gguf
embedding_hf_model_name: BAAI/bge-large-en
prompt_style: "llama2"
```