github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-29 18:08:36 +00:00
Code Issues Packages Projects Releases Wiki Activity

Latest version of HazyResearch/manifest doesn't support accessing "client" directly (#10389)

Browse Source 
**Description:** 
The latest version of HazyResearch/manifest doesn't support accessing
the "client" directly. The latest version supports connection pools and
a client has to be requested from the client pool.
**Issue:**
No matching issue was found
**Dependencies:** 
The manifest.ipynb file in docs/extras/integrations/llms need to be
updated
**Twitter handle:** 
@hrk_cbe
This commit is contained in:
Rajesh Kumar 2023-09-12 02:52:53 +05:30 committed by GitHub
parent 31739577c2
commit 737b75d278
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 5 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/extras/integrations/llms/manifest.ipynb
View File

@ -57,7 +57,7 @@
"manifest = Manifest(\n", "manifest = Manifest(\n",
" client_name=\"huggingface\", client_connection=\"http://127.0.0.1:5000\"\n", " client_name=\"huggingface\", client_connection=\"http://127.0.0.1:5000\"\n",
")\n", ")\n",
"print(manifest.client.get_model_params())" "print(manifest.client_pool.get_current_client().get_model_params())"
] ]
}, },
{ {

5
libs/langchain/langchain/llms/manifest.py
View File

@ -34,7 +34,10 @@ class ManifestWrapper(LLM):
@property @property
def _identifying_params(self) -> Mapping[str, Any]: def _identifying_params(self) -> Mapping[str, Any]:
kwargs = self.llm_kwargs or {} kwargs = self.llm_kwargs or {}
return {**self.client.client.get_model_params(), **kwargs} return {
**self.client.client_pool.get_current_client().get_model_params(),
**kwargs,
}
@property @property
def _llm_type(self) -> str: def _llm_type(self) -> str: