github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-10-13 10:38:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat(llm): drop default_system_prompt (#1385)

Browse Source 
As discussed on Discord, the decision has been made to remove the system prompts by default, to better segregate the API and the UI usages.

A concurrent PR (#1353) is enabling the dynamic setting of a system prompt in the UI.

Therefore, if UI users want to use a custom system prompt, they can specify one directly in the UI.
If the API users want to use a custom prompt, they can pass it directly into their messages that they are passing to the API.

In the highlight of the two use case above, it becomes clear that default system_prompt does not need to exist.
This commit is contained in:
Louis Melchior
2023-12-08 23:13:51 +01:00
committed by GitHub
parent f235c50be9
commit a3ed14c58f
4 changed files with 17 additions and 96 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
private_gpt/components/llm/llm_component.py
View File

@@ -23,10 +23,7 @@ class LLMComponent:
case "local":
from llama_index.llms import LlamaCPP
prompt_style_cls = get_prompt_style(settings.local.prompt_style)
prompt_style = prompt_style_cls(
default_system_prompt=settings.local.default_system_prompt
)
prompt_style = get_prompt_style(settings.local.prompt_style)
self.llm = LlamaCPP(
model_path=str(models_path / settings.local.llm_hf_model_file),