docs: prep index barebones

This commit is contained in:
Zach Nussbaum 2023-04-25 20:34:26 +00:00
parent 586a8abc06
commit f2161f7e59

View File

@ -25,3 +25,10 @@ import hnswlib
index = hnswlib.Index(space='l2', dim=384)
index.load_index(<path to index>)
```
Prep index for train
```
CUDA_VISIBLE_DEVICES=7 torchrun --master_port=29086 --nproc-per-node 1 prep_index_for_train.py --config=../../configs/train/finetune_gptjr.yaml
```