github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-07-06 13:18:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
wfh/rm_context_api
langchain/libs/partners/huggingface/langchain_huggingface/llms
History
Teruaki Ishizaki aeb42dc900
partners: Fixed the procedure of initializing pad_token_id (#29500) 
- **Description:** Add to check pad_token_id and eos_token_id of model
config. It seems that this is the same bug as the HuggingFace TGI bug.
It's same bug as #29434
- **Issue:** #29431
- **Dependencies:** none
- **Twitter handle:** tell14

Example code is followings:
```python
from langchain_huggingface.llms import HuggingFacePipeline

hf = HuggingFacePipeline.from_model_id(
    model_id="meta-llama/Llama-3.2-3B-Instruct",
    task="text-generation",
    pipeline_kwargs={"max_new_tokens": 10},
)

from langchain_core.prompts import PromptTemplate

template = """Question: {question}

Answer: Let's think step by step."""
prompt = PromptTemplate.from_template(template)

chain = prompt | hf

question = "What is electroencephalography?"

print(chain.invoke({"question": question}))
```
2025-02-03 21:40:33 -05:00
..
__init__.py infra: update mypy 1.10, ruff 0.5 (#23721) 2024-07-03 10:33:27 -07:00
huggingface_endpoint.py Revert "huggingface[patch]: make HuggingFaceEndpoint serializable (#2… (#27032) 2024-10-01 21:26:38 +00:00
huggingface_pipeline.py partners: Fixed the procedure of initializing pad_token_id (#29500) 2025-02-03 21:40:33 -05:00