Use a different text splitter to improve results. Ingest takes an argument pointing to the doc to ingest.

This commit is contained in:
Iván Martínez
2023-05-05 17:32:31 +02:00
parent a05186b598
commit 92244a90b4
2 changed files with 6 additions and 6 deletions

View File

@@ -20,13 +20,12 @@ This repo uses a [state of the union transcript](https://github.com/imartinez/pr
## Instructions for ingesting your own dataset
Place your .txt file in `source_documents` folder.
Edit `ingest.py` loader to point it to your document.
Get your .txt file ready.
Run the following command to ingest the data.
```shell
python ingest.py
python ingest.py <path_to_your_txt_file>
```
It will create a `db` folder containing the local vectorstore. Will take time, depending on the size of your document.