github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-24 07:35:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

huggingface: handle image-text-to-text pipeline task (#31611)

Browse Source 
**Description:** Allows for HuggingFacePipeline to handle
image-text-to-text pipeline
This commit is contained in:
Peter Schneider 2025-06-14 13:41:11 -07:00 committed by GitHub
parent 50f998a138
commit cecfec5efa
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 5 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
libs/partners/huggingface/langchain_huggingface/llms/huggingface_pipeline.py
View File

@ -23,6 +23,7 @@ DEFAULT_TASK = "text-generation"
VALID_TASKS = ( VALID_TASKS = (
"text2text-generation", "text2text-generation",
"text-generation", "text-generation",
"image-text-to-text",
"summarization", "summarization",
"translation", "translation",
) )
@ -38,8 +39,8 @@ class HuggingFacePipeline(BaseLLM):
To use, you should have the ``transformers`` python package installed. To use, you should have the ``transformers`` python package installed.
Only supports `text-generation`, `text2text-generation`, `summarization` and Only supports `text-generation`, `text2text-generation`, `image-text-to-text`,
`translation` for now. `summarization` and `translation` for now.
Example using from_model_id: Example using from_model_id:
.. code-block:: python .. code-block:: python
@ -327,6 +328,8 @@ class HuggingFacePipeline(BaseLLM):
text = response["generated_text"] text = response["generated_text"]
elif self.pipeline.task == "text2text-generation": elif self.pipeline.task == "text2text-generation":
text = response["generated_text"] text = response["generated_text"]
elif self.pipeline.task == "image-text-to-text":
text = response["generated_text"]
elif self.pipeline.task == "summarization": elif self.pipeline.task == "summarization":
text = response["summary_text"] text = response["summary_text"]
elif self.pipeline.task in "translation": elif self.pipeline.task in "translation":