docs[patch]: add warning to token counter docstring (#30426)

This commit is contained in:
Vadym Barda 2025-03-21 18:59:40 -04:00 committed by GitHub
parent 3933a4abc3
commit 673ec00030
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -1529,6 +1529,9 @@ def count_tokens_approximately(
This is a simple approximation that may not match the exact token count
used by specific models. For accurate counts, use model-specific tokenizers.
Warning:
This function does not currently support counting image tokens.
.. versionadded:: 0.3.46
"""
token_count = 0.0