github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-26 08:33:49 +00:00
Code Issues Packages Projects Releases Wiki Activity

Harrison/llamacpp (#5402)

Browse Source 
Co-authored-by: Gavin S <gavinswanson@gmail.com>
This commit is contained in:
Harrison Chase 2023-05-29 06:44:58 -07:00 committed by GitHub
parent 642ae83d86
commit 3e16468423
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
langchain/llms/llamacpp.py
View File

@ -279,3 +279,7 @@ class LlamaCpp(LLM):
token=token, verbose=self.verbose, log_probs=log_probs
)
yield chunk
def get_num_tokens(self, text: str) -> int:
tokenized_text = self.client.tokenize(text.encode("utf-8"))
return len(tokenized_text)