docs[patch]: add warning to token counter docstring (#30426)

This commit is contained in:
Vadym Barda
2025-03-21 18:59:40 -04:00
committed by GitHub
parent 3933a4abc3
commit 673ec00030

View File

@@ -1529,6 +1529,9 @@ def count_tokens_approximately(
This is a simple approximation that may not match the exact token count
used by specific models. For accurate counts, use model-specific tokenizers.
Warning:
This function does not currently support counting image tokens.
.. versionadded:: 0.3.46
"""
token_count = 0.0