github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-21 06:14:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

Prompt fix for empty intermediate steps in summarization (#660)

Browse Source 
Adding quotation marks around {text} avoids generating empty or
completely random responses from OpenAI davinci-003. Empty or completely
unrelated intermediate responses in summarization messes up the final
result or makes it very inaccurate.
The error from OpenAI would be: "The model predicted a completion that
begins with a stop sequence, resulting in no output. Consider adjusting
your prompt or stop sequences."
This fix corrects the prompting for summarization chain. This works on
API too, the images are for demonstrative purposes.
This approach can be applied to other similar prompts too. 

Examples:

1) Without quotation marks
![Screenshot from 2023-01-20
07-18-19](https://user-images.githubusercontent.com/22897470/213624365-9dfc18f9-5f3f-45d2-abe1-56de67397e22.png)

2) With quotation marks
![Screenshot from 2023-01-20
07-18-35](https://user-images.githubusercontent.com/22897470/213624478-c958e742-a4a7-46fe-a163-eca6326d9dae.png)
This commit is contained in:
vertinski 2023-01-20 17:37:01 +02:00 committed by GitHub
parent 69998b5fad
commit 65f3a341b0
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
langchain/chains/summarize/map_reduce_prompt.py
View File

@ -4,7 +4,7 @@ from langchain.prompts import PromptTemplate
prompt_template = """Write a concise summary of the following:
{text}
"{text}"
CONCISE SUMMARY:"""

2
langchain/chains/summarize/refine_prompts.py
View File

@ -21,7 +21,7 @@ REFINE_PROMPT = PromptTemplate(
prompt_template = """Write a concise summary of the following:
{text}
"{text}"
CONCISE SUMMARY:"""

2
langchain/chains/summarize/stuff_prompt.py
View File

@ -4,7 +4,7 @@ from langchain.prompts import PromptTemplate
prompt_template = """Write a concise summary of the following:
{text}
"{text}"
CONCISE SUMMARY:"""