github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-07-04 12:18:24 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[patch]: Invoke callback prior to yielding token (titan_takeoff) (#18560)

Browse Source 
## PR title
community[patch]: Invoke callback prior to yielding token

## PR message
- Description: Invoke callback prior to yielding token in _stream_
method in llms/titan_takeoff.
- Issue: #16913 
- Dependencies: None
This commit is contained in:
Yudhajit Sinha 2024-03-06 02:24:26 +05:30 committed by GitHub
parent ea51cdaede
commit 4570b477b9
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
libs/community/langchain_community/llms/titan_takeoff.py
View File

@ -151,9 +151,9 @@ class TitanTakeoff(LLM):
for text in response.iter_content(chunk_size=1, decode_unicode=True): for text in response.iter_content(chunk_size=1, decode_unicode=True):
if text: if text:
chunk = GenerationChunk(text=text) chunk = GenerationChunk(text=text)
yield chunk
if run_manager: if run_manager:
run_manager.on_llm_new_token(token=chunk.text) run_manager.on_llm_new_token(token=chunk.text)
yield chunk
@property @property
def _identifying_params(self) -> Mapping[str, Any]: def _identifying_params(self) -> Mapping[str, Any]: