github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-18 12:58:59 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fix the unset argument in calling llama model (#2714)

Browse Source 
When using the llama.cpp together with agent like
zero-shot-react-description, the missing branch will cause the parameter
`stop` left empty, resulting in unexpected output format from the model.

This patch fixes that issue.
This commit is contained in:
134ARG 2023-04-12 02:02:39 +08:00 committed by GitHub
parent f435f2267c
commit 1e60e6e15b
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
langchain/llms/llamacpp.py
View File

@ -177,6 +177,8 @@ class LlamaCpp(LLM):
raise ValueError("`stop` found in both the input and default params.") raise ValueError("`stop` found in both the input and default params.")
elif self.stop: elif self.stop:
params["stop_sequences"] = self.stop params["stop_sequences"] = self.stop
elif stop:
params["stop_sequences"] = stop
else: else:
params["stop_sequences"] = [] params["stop_sequences"] = []