github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-20 05:43:55 +00:00
Code Issues Packages Projects Releases Wiki Activity

community: fix an issue with deepinfra integration (#28715)

Browse Source 
Thank you for contributing to LangChain!

- [x] **PR title**: langchain: add URL parameter to ChatDeepInfra class

- [x] **PR message**: add URL parameter to ChatDeepInfra class
- **Description:** This PR introduces a url parameter to the
ChatDeepInfra class in LangChain, allowing users to specify a custom
URL. Previously, the URL for the DeepInfra API was hardcoded to
"https://stage.api.deepinfra.com/v1/openai/chat/completions", which
caused issues when the staging endpoint was not functional. The _url
method was updated to return the value from the url parameter, enabling
greater flexibility and addressing the problem. out!

---------

Co-authored-by: Erick Friis <erick@langchain.dev>
This commit is contained in:
Nawaf Alharbi 2024-12-14 05:15:29 +03:00 committed by GitHub
parent 008efada2c
commit decd77c515
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
libs/community/langchain_community/chat_models/deepinfra.py
View File

@ -207,6 +207,10 @@ class ChatDeepInfra(BaseChatModel):
# client: Any #: :meta private: # client: Any #: :meta private:
model_name: str = Field(default="meta-llama/Llama-2-70b-chat-hf", alias="model") model_name: str = Field(default="meta-llama/Llama-2-70b-chat-hf", alias="model")
"""Model name to use.""" """Model name to use."""
url: str = "https://api.deepinfra.com/v1/openai/chat/completions"
"""URL to use for the API call."""
deepinfra_api_token: Optional[str] = None deepinfra_api_token: Optional[str] = None
request_timeout: Optional[float] = Field(default=None, alias="timeout") request_timeout: Optional[float] = Field(default=None, alias="timeout")
temperature: Optional[float] = 1 temperature: Optional[float] = 1
@ -469,7 +473,7 @@ class ChatDeepInfra(BaseChatModel):
) )
def _url(self) -> str: def _url(self) -> str:
return "https://stage.api.deepinfra.com/v1/openai/chat/completions" return self.url
def _headers(self) -> Dict: def _headers(self) -> Dict:
return { return {