github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-08-06 19:48:26 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[fix]: Update Perplexity to pass parameters into API calls (#28421)

Browse Source 
- [x] **PR title**: "package: description"
- Where "package" is whichever of langchain, community, core, etc. is
being modified. Use "docs: ..." for purely docs changes, "infra: ..."
for CI changes.
  - Example: "community: add foobar LLM"


- **Description:** I realized the invocation parameters were not being
passed into `_generate` so I added those in but then realized that the
parameters contained some old fields designed for an older openai client
which I removed. Parameters work fine now.
- **Issue:** Fixes #28229 
- **Dependencies:** No new dependencies.  
- **Twitter handle:** @arch_plane

- [x] **Lint and test**: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified. See contribution
guidelines for more: https://python.langchain.com/docs/contributing/

Additional guidelines:
- Make sure optional dependencies are imported within a function.
- Please do not add dependencies to pyproject.toml files (even optional
ones) unless they are required for unit tests.
- Most PRs should not touch more than one package.
- Changes should be backwards compatible.
- If you are adding something to community, do not re-import it in
langchain.

If no one reviews your PR within a few days, please @-mention one of
baskaryan, efriis, eyurtsev, ccurme, vbarda, hwchase17.

Co-authored-by: Erick Friis <erick@langchain.dev>
This commit is contained in:
Arnav Priyadarshi 2024-12-09 19:23:31 -05:00 committed by GitHub
parent 34ca31e467
commit b78b2f7a28
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 7 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
libs/community/langchain_community/chat_models/perplexity.py
View File

@ -148,7 +148,6 @@ class ChatPerplexity(BaseChatModel):
def _default_params(self) -> Dict[str, Any]: def _default_params(self) -> Dict[str, Any]:
"""Get the default parameters for calling PerplexityChat API.""" """Get the default parameters for calling PerplexityChat API."""
return { return {
"request_timeout": self.request_timeout,
"max_tokens": self.max_tokens, "max_tokens": self.max_tokens,
"stream": self.streaming, "stream": self.streaming,
"temperature": self.temperature, "temperature": self.temperature,
@ -222,7 +221,7 @@ class ChatPerplexity(BaseChatModel):
if stop: if stop:
params["stop_sequences"] = stop params["stop_sequences"] = stop
stream_resp = self.client.chat.completions.create( stream_resp = self.client.chat.completions.create(
model=params["model"], messages=message_dicts, stream=True messages=message_dicts, stream=True, **params
) )
for chunk in stream_resp: for chunk in stream_resp:
if not isinstance(chunk, dict): if not isinstance(chunk, dict):
@ -258,9 +257,7 @@ class ChatPerplexity(BaseChatModel):
return generate_from_stream(stream_iter) return generate_from_stream(stream_iter)
message_dicts, params = self._create_message_dicts(messages, stop) message_dicts, params = self._create_message_dicts(messages, stop)
params = {**params, **kwargs} params = {**params, **kwargs}
response = self.client.chat.completions.create( response = self.client.chat.completions.create(messages=message_dicts, **params)
model=params["model"], messages=message_dicts
)
message = AIMessage( message = AIMessage(
content=response.choices[0].message.content, content=response.choices[0].message.content,
additional_kwargs={"citations": response.citations}, additional_kwargs={"citations": response.citations},
@ -271,8 +268,6 @@ class ChatPerplexity(BaseChatModel):
def _invocation_params(self) -> Mapping[str, Any]: def _invocation_params(self) -> Mapping[str, Any]:
"""Get the parameters used to invoke the model.""" """Get the parameters used to invoke the model."""
pplx_creds: Dict[str, Any] = { pplx_creds: Dict[str, Any] = {
"api_key": self.pplx_api_key,
"api_base": "https://api.perplexity.ai",
"model": self.model, "model": self.model,
} }
return {**pplx_creds, **self._default_params} return {**pplx_creds, **self._default_params}