community[patch]: LanceDB integration improvements/fixes (#16173)

Hi, I'm from the LanceDB team.

Improves LanceDB integration by making it easier to use - now you aren't
required to create tables manually and pass them in the constructor,
although that is still backward compatible.

Bug fix - pandas was being used even though it's not a dependency for
LanceDB or langchain

PS - this issue was raised a few months ago but lost traction. It is a
feature improvement for our users kindly review this , Thanks !
This commit is contained in:
Raghav Dixit
2024-02-19 13:22:02 -05:00
committed by GitHub
parent e92e96193f
commit 6c18f73ca5
4 changed files with 226 additions and 74 deletions

File diff suppressed because one or more lines are too long

View File

@@ -131,7 +131,7 @@ table = db.create_table(
raw_documents = TextLoader('../../../state_of_the_union.txt').load()
text_splitter = CharacterTextSplitter(chunk_size=1000, chunk_overlap=0)
documents = text_splitter.split_documents(raw_documents)
db = LanceDB.from_documents(documents, OpenAIEmbeddings(), connection=table)
db = LanceDB.from_documents(documents, OpenAIEmbeddings())
```
</TabItem>