mirror of
https://github.com/hwchase17/langchain.git
synced 2025-06-28 17:38:36 +00:00
docs: fixed tiktoken link error (#14840)
<!-- Thank you for contributing to LangChain! Replace this entire comment with: - **Description:** fixed tiktoken link error, - **Issue:** no, - **Dependencies:** no, - **Tag maintainer:** for a quicker response, tag the relevant maintainer (see below), - **Twitter handle:** no! Please make sure your PR is passing linting and testing before submitting. Run `make format`, `make lint` and `make test` to check this locally. See contribution guidelines for more information on how to write/run tests, lint, etc: https://python.langchain.com/docs/contributing/ If you're adding a new integration, please include: 1. a test for the integration, preferably unit tests that do not rely on network access, 2. an example notebook showing its use. It lives in `docs/extras` directory. If no one reviews your PR within a few days, please @-mention one of @baskaryan, @eyurtsev, @hwchase17. --> - **Description:** fixed tiktoken link error, - **Issue:** no, - **Dependencies:** no, - **Tag maintainer:** @baskaryan, - **Twitter handle:** SignetCode!
This commit is contained in:
parent
6577b0d987
commit
07ba030a4e
@ -73,7 +73,7 @@ You can also use it to count tokens when splitting documents with
|
||||
from langchain.text_splitter import CharacterTextSplitter
|
||||
CharacterTextSplitter.from_tiktoken_encoder(...)
|
||||
```
|
||||
For a more detailed walkthrough of this, see [this notebook](/docs/modules/data_connection/document_transformers/text_splitters/tiktoken)
|
||||
For a more detailed walkthrough of this, see [this notebook](/docs/modules/data_connection/document_transformers/text_splitters/split_by_token#tiktoken)
|
||||
|
||||
## Document Loader
|
||||
|
||||
|
Loading…
Reference in New Issue
Block a user