community[patch]: Invoke callback prior to yielding token (pai_eas_endpoint) (#18627)

## PR title
community[patch]: Invoke callback prior to yielding token

## PR message
- Description: Invoke callback prior to yielding token in _stream_
method in llms/pai_eas_endpoint.
- Issue: #16913 
- Dependencies: None
This commit is contained in:
Yudhajit Sinha 2024-03-20 20:26:58 +05:30 committed by GitHub
parent 140f06e59a
commit 9525e392de
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -231,9 +231,9 @@ class PaiEasEndpoint(LLM):
# yield text, if any
if text:
res = GenerationChunk(text=text)
yield res
if run_manager:
run_manager.on_llm_new_token(res.text)
yield res
# break if stop sequence found
if stop_seq_found: