mirror of
https://github.com/hwchase17/langchain.git
synced 2026-04-03 19:04:23 +00:00
Use docusaurus versioning with a callout, merged master as well @hwchase17 @baskaryan --------- Signed-off-by: Weichen Xu <weichen.xu@databricks.com> Signed-off-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: Leonid Ganeline <leo.gan.57@gmail.com> Co-authored-by: Leonid Kuligin <lkuligin@yandex.ru> Co-authored-by: Averi Kitsch <akitsch@google.com> Co-authored-by: Erick Friis <erick@langchain.dev> Co-authored-by: Nuno Campos <nuno@langchain.dev> Co-authored-by: Nuno Campos <nuno@boringbits.io> Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com> Co-authored-by: Eugene Yurtsev <eyurtsev@gmail.com> Co-authored-by: Martín Gotelli Ferenaz <martingotelliferenaz@gmail.com> Co-authored-by: Fayfox <admin@fayfox.com> Co-authored-by: Eugene Yurtsev <eugene@langchain.dev> Co-authored-by: Dawson Bauer <105886620+djbauer2@users.noreply.github.com> Co-authored-by: Ravindu Somawansa <ravindu.somawansa@gmail.com> Co-authored-by: Dhruv Chawla <43818888+Dominastorm@users.noreply.github.com> Co-authored-by: ccurme <chester.curme@gmail.com> Co-authored-by: Bagatur <baskaryan@gmail.com> Co-authored-by: WeichenXu <weichen.xu@databricks.com> Co-authored-by: Benito Geordie <89472452+benitoThree@users.noreply.github.com> Co-authored-by: kartikTAI <129414343+kartikTAI@users.noreply.github.com> Co-authored-by: Kartik Sarangmath <kartik@thirdai.com> Co-authored-by: Sevin F. Varoglu <sfvaroglu@octoml.ai> Co-authored-by: MacanPN <martin.triska@gmail.com> Co-authored-by: Prashanth Rao <35005448+prrao87@users.noreply.github.com> Co-authored-by: Hyeongchan Kim <kozistr@gmail.com> Co-authored-by: sdan <git@sdan.io> Co-authored-by: Guangdong Liu <liugddx@gmail.com> Co-authored-by: Rahul Triptahi <rahul.psit.ec@gmail.com> Co-authored-by: Rahul Tripathi <rauhl.psit.ec@gmail.com> Co-authored-by: pjb157 <84070455+pjb157@users.noreply.github.com> Co-authored-by: Eun Hye Kim <ehkim1440@gmail.com> Co-authored-by: kaijietti <43436010+kaijietti@users.noreply.github.com> Co-authored-by: Pengcheng Liu <pcliu.fd@gmail.com> Co-authored-by: Tomer Cagan <tomer@tomercagan.com> Co-authored-by: Christophe Bornet <cbornet@hotmail.com>
63 lines
1.8 KiB
Plaintext
63 lines
1.8 KiB
Plaintext
# VDMS
|
|
|
|
> [VDMS](https://github.com/IntelLabs/vdms/blob/master/README.md) is a storage solution for efficient access
|
|
> of big-”visual”-data that aims to achieve cloud scale by searching for relevant visual data via visual metadata
|
|
> stored as a graph and enabling machine friendly enhancements to visual data for faster access.
|
|
|
|
## Installation and Setup
|
|
|
|
### Install Client
|
|
|
|
```bash
|
|
pip install vdms
|
|
```
|
|
|
|
### Install Database
|
|
|
|
There are two ways to get started with VDMS:
|
|
|
|
#### Install VDMS on your local machine via docker
|
|
```bash
|
|
docker run -d -p 55555:55555 intellabs/vdms:latest
|
|
```
|
|
|
|
#### Install VDMS directly on your local machine
|
|
Please see [installation instructions](https://github.com/IntelLabs/vdms/blob/master/INSTALL.md).
|
|
|
|
|
|
|
|
## VectorStore
|
|
|
|
The vector store is a simple wrapper around VDMS. It provides a simple interface to store and retrieve data.
|
|
|
|
```python
|
|
from langchain_community.document_loaders import TextLoader
|
|
from langchain.text_splitter import CharacterTextSplitter
|
|
|
|
loader = TextLoader("./state_of_the_union.txt")
|
|
documents = loader.load()
|
|
text_splitter = CharacterTextSplitter(chunk_size=500, chunk_overlap=0)
|
|
docs = text_splitter.split_documents(documents)
|
|
|
|
from langchain_community.vectorstores import VDMS
|
|
from langchain_community.vectorstores.vdms import VDMS_Client
|
|
from langchain_community.embeddings.huggingface import HuggingFaceEmbeddings
|
|
|
|
client = VDMS_Client("localhost", 55555)
|
|
vectorstore = VDMS.from_documents(
|
|
docs,
|
|
client=client,
|
|
collection_name="langchain-demo",
|
|
embedding_function=HuggingFaceEmbeddings(),
|
|
engine="FaissFlat"
|
|
distance_strategy="L2",
|
|
)
|
|
|
|
query = "What did the president say about Ketanji Brown Jackson"
|
|
results = vectorstore.similarity_search(query)
|
|
```
|
|
|
|
For a more detailed walkthrough of the VDMS wrapper, see [this notebook](/docs/integrations/vectorstores/vdms)
|
|
|
|
|