mirror of
https://github.com/hwchase17/langchain.git
synced 2025-05-18 13:31:36 +00:00
b023f0c0f2
This creates a new kind of text splitter for markdown files. The user can supply a set of headers that they want to split the file on. We define a new text splitter class, `MarkdownHeaderTextSplitter`, that does a few things: (1) For each line, it determines the associated set of user-specified headers (2) It groups lines with common headers into splits See notebook for example usage and test cases. |
||
|---|---|---|
| .. | ||
| agents | ||
| callbacks | ||
| chains | ||
| indexes | ||
| memory | ||
| models | ||
| prompts | ||
| utils/examples | ||
| agents.rst | ||
| chains.rst | ||
| indexes.rst | ||
| memory.rst | ||
| models.rst | ||
| paul_graham_essay.txt | ||
| prompts.rst | ||
| state_of_the_union.txt | ||