github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-09-10 19:49:34 +00:00
Code Issues Packages Projects Releases Wiki Activity

Use chromadb max_batch_size public attribute

Browse Source
This commit is contained in:
Iván Martínez
2023-09-25 11:42:16 +02:00
parent 91163a247b
commit 0db5aebf2f
4 changed files with 138 additions and 319 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
ingest.py
View File

@@ -136,8 +136,7 @@ def batch_chromadb_insertions(chroma_client: API, documents: List[Document]) ->
Split the total documents to be inserted into batches of documents that the local chroma client can process
"""
# Get max batch size.
# Note: temp hack given max_batch_size is not yet exposed by ChromaDB API (WIP).
max_batch_size = chroma_client._producer.max_batch_size
max_batch_size = chroma_client.max_batch_size
for i in range(0, len(documents), max_batch_size):
yield documents[i:i + max_batch_size]