github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-09-05 17:21:02 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat: add mistral + chatml prompts (#1426)

Browse Source
This commit is contained in:
CognitiveTech
2024-01-16 16:51:14 -05:00
committed by GitHub
parent 6191bcdbd6
commit e326126d0d
6 changed files with 107 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

20
fern/docs/pages/recipes/list-llm.mdx
View File

@@ -24,7 +24,7 @@ user: {{ user_message }}
assistant: {{ assistant_message }}
```
And the "`tag`" style looks like this:
The "`tag`" style looks like this:
```text
<|system|>: {{ system_prompt }}
@@ -32,7 +32,23 @@ And the "`tag`" style looks like this:
<|assistant|>: {{ assistant_message }}
```
Some LLMs will not understand this prompt style, and will not work (returning nothing).
The "`mistral`" style looks like this:
```text
<s>[INST] You are an AI assistant. [/INST]</s>[INST] Hello, how are you doing? [/INST]
```
The "`chatml`" style looks like this:
```text
<|im_start|>system
{{ system_prompt }}<|im_end|>
<|im_start|>user"
{{ user_message }}<|im_end|>
<|im_start|>assistant
{{ assistant_message }}
```
Some LLMs will not understand these prompt styles, and will not work (returning nothing).
You can try to change the prompt style to `default` (or `tag`) in the settings, and it will
change the way the messages are formatted to be passed to the LLM.