One Line Fix: missing text output with huggingface TGI LLM (#7972)

Small bug fix. The async _call method was missing a line to return the
generated text.

@baskaryan
This commit is contained in:
Wian Stipp
2023-07-20 06:44:29 -07:00
committed by GitHub
parent 493cbc9410
commit 0ffb7fc10c

View File

@@ -255,4 +255,5 @@ class HuggingFaceTextGenInference(LLM):
if not token.special:
if text_callback:
await text_callback(token.text)
text += token.text
return text