From 28d03fdda8a5303c3c9d8601d3a280080f524ef9 Mon Sep 17 00:00:00 2001 From: ishaandatta <51422391+ishaandatta@users.noreply.github.com> Date: Thu, 30 Nov 2023 01:24:22 +0530 Subject: [PATCH] Adding working combination of LLM and Embedding Model to recipes (#1315) Co-authored-by: ishaandatta --- fern/docs/pages/recipes/list-llm.mdx | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/fern/docs/pages/recipes/list-llm.mdx b/fern/docs/pages/recipes/list-llm.mdx index a3e32b85..19ae479f 100644 --- a/fern/docs/pages/recipes/list-llm.mdx +++ b/fern/docs/pages/recipes/list-llm.mdx @@ -81,4 +81,15 @@ Context: None Situation: tu es au milieu d'un champ. Tache: va a la rivière, en bas du champ. Décrit comment aller a la rivière. +``` + +### Optimised Models +GodziLLa2-70B LLM (English, rank 2 on HuggingFace OpenLLM Leaderboard), bge large Embedding Model (rank 1 on HuggingFace MTEB Leaderboard) +`settings-optimised.yaml`: +```yml +local: + llm_hf_repo_id: TheBloke/GodziLLa2-70B-GGUF + llm_hf_model_file: godzilla2-70b.Q4_K_M.gguf + embedding_hf_model_name: BAAI/bge-large-en + prompt_style: "llama2" ``` \ No newline at end of file