Stijn Tratsaert c386265acb VertexAI LLM count_tokens method requires list of prompts (#13451) ...

I encountered this during summarization with VertexAI. I was receiving
an INVALID_ARGUMENT error, as it was trying to send a list of about
17000 single characters.

The [count_tokens
method](https://github.com/googleapis/python-aiplatform/blob/main/vertexai/language_models/_language_models.py#L658)
made available by Google takes in a list of prompts. It does not fail
for small texts, but it does for longer documents because the argument
list will be exceeding Googles allowed limit. Enforcing the list type
makes it work successfully.

This change will cast the input text to count to a list of that single
text so that the input format is always correct.

[Twitter](https://www.x.com/stijn_tratsaert)

2023-11-23 16:06:18 -05:00

..

cli

IMPROVEMENT Lock pydantic v1 in app template, cli 0.0.18 (#13485)

2023-11-23 16:06:16 -05:00

experimental

bump 338, exp 42 (#13564)

2023-11-23 16:06:17 -05:00

langchain

VertexAI LLM count_tokens method requires list of prompts (#13451)

2023-11-23 16:06:18 -05:00