github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-22 14:49:29 +00:00
Code Issues Packages Projects Releases Wiki Activity

add api_base to _client_params (community version of #14393) (#14644)

Browse Source 
- **Description:** This PR adds `api_base` to `_client_params` in the
`chat_model` of LiteLLM to ensure it's included in API calls.
Previously, `api_base` was set on the client but was not included in the
parameters passed to the completion function. This change ensures that
`api_base` is correctly passed to all API calls.
  - **Issue:** #14338
  - **Tag maintainer:** @hwchase17 @agola11
  - **Twitter handle:** @LMS_David_RS
This commit is contained in:
David 2024-01-02 01:53:16 +01:00 committed by GitHub
parent 3bd0a15506
commit dcf047c48f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
libs/community/langchain_community/chat_models/litellm.py
View File

@ -223,6 +223,7 @@ class ChatLiteLLM(BaseChatModel):
creds: Dict[str, Any] = { creds: Dict[str, Any] = {
"model": set_model_value, "model": set_model_value,
"force_timeout": self.request_timeout, "force_timeout": self.request_timeout,
"api_base": self.api_base,
} }
return {**self._default_params, **creds} return {**self._default_params, **creds}