langchain/docs/docs/integrations/retrievers
Vishnu Nandakumar e271965d1e
community: retrievers: added capability for using Product Quantization as one of the retriever. (#22424)
- [ ] **Community**: "Retrievers: Product Quantization"
- [X] This PR adds Product Quantization feature to the retrievers to the
Langchain Community. PQ is one of the fastest retrieval methods if the
embeddings are rich enough in context due to the concepts of
quantization and representation through centroids
    - **Description:** Adding PQ as one of the retrievers
    - **Dependencies:** using the package nanopq for this PR
    - **Twitter handle:** vishnunkumar_


- [X] **Add tests and docs**: If you're adding a new integration, please
include
   - [X] Added unit tests for the same in the retrievers.
   - [] Will add an example notebook subsequently

- [X] **Lint and test**: Run `make format`, `make lint` and `make test`
from the root of the package(s) you've modified. See contribution
guidelines for more: https://python.langchain.com/docs/contributing/ -
done the same

---------

Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
Co-authored-by: Chester Curme <chester.curme@gmail.com>
2024-07-24 13:52:15 +00:00
..
self_query community[minor]: Vectara Integration Update - Streaming, FCS, Chat, updates to documentation and example notebooks (#21334) 2024-06-04 12:57:28 -07:00
activeloop.ipynb docs: Remove non-rendering images & output spamming from doc ntbks (#19475) 2024-03-24 23:47:38 -07:00
amazon_kendra_retriever.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
arcee.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
arxiv.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
asknews.ipynb community[minor]: add AskNews retriever and AskNews tool (#21581) 2024-05-20 18:23:06 -07:00
azure_ai_search.ipynb docs: migrate integrations using langchain-cli (#21929) 2024-05-20 18:14:49 +00:00
bedrock.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
bm25.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
breebs.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
chaindesk.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
chatgpt-plugin.ipynb docs: migrate integrations using langchain-cli (#21929) 2024-05-20 18:14:49 +00:00
cohere-reranker.ipynb docs: model parameter mandatory for cohere embedding and rerank (#23349) 2024-07-12 23:07:28 +00:00
cohere.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
docarray_retriever.ipynb docs: migrate integrations using langchain-cli (#21929) 2024-05-20 18:14:49 +00:00
dria_index.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
elastic_search_bm25.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
elasticsearch_retriever.ipynb docs: migrate integrations using langchain-cli (#21929) 2024-05-20 18:14:49 +00:00
embedchain.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
flashrank-reranker.ipynb docs: fix path for state_of_the_union sample file (#21609) 2024-05-13 11:46:02 -04:00
fleet_context.ipynb docs; fix links in v0.2.0 (#21483) 2024-05-09 11:05:17 -04:00
google_drive.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
google_vertex_ai_search.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
jaguar.ipynb docs: fix path for state_of_the_union sample file (#21609) 2024-05-13 11:46:02 -04:00
kay.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
kinetica.ipynb community[patch]: Kinetica Integrations handled error in querying; quotes in table names; updated gpudb API (#22724) 2024-06-11 10:01:26 -04:00
knn.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
llmlingua.ipynb docs: fix path for state_of_the_union sample file (#21609) 2024-05-13 11:46:02 -04:00
merger_retriever.ipynb docs: huggingface package (#21645) 2024-05-14 03:17:40 +00:00
metal.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
milvus_hybrid_search.ipynb milvus: New langchain_milvus package and new milvus features (#21077) 2024-05-28 08:24:20 -07:00
nanopq.ipynb community: retrievers: added capability for using Product Quantization as one of the retriever. (#22424) 2024-07-24 13:52:15 +00:00
outline.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
pinecone_hybrid_search.ipynb docs: update notebook for latest Pinecone API + serverless (#21921) 2024-05-20 11:51:03 -07:00
pubmed.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
qdrant-sparse.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
ragatouille.ipynb docs; fix links in v0.2.0 (#21483) 2024-05-09 11:05:17 -04:00
re_phrase.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
rememberizer.ipynb community[minor]: Rememberizer retriever (#20052) 2024-05-01 10:41:44 -04:00
sec_filings.ipynb docs: integrations/retrievers cleanup (#20357) 2024-04-19 10:02:41 -04:00
singlestoredb.ipynb docs: fix path for state_of_the_union sample file (#21609) 2024-05-13 11:46:02 -04:00
svm.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
tavily.ipynb docs; fix links in v0.2.0 (#21483) 2024-05-09 11:05:17 -04:00
tf_idf.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
thirdai_neuraldb.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
vespa.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
weaviate-hybrid.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
wikipedia.ipynb patch: deprecate (a)get_relevant_documents (#20477) 2024-04-22 11:14:53 -04:00
you-retriever.ipynb docs: integrations/retrievers cleanup (#20357) 2024-04-19 10:02:41 -04:00
zep_cloud_memorystore.ipynb community[minor]: Add Zep Cloud components + docs + examples (#21671) 2024-05-27 12:50:13 -07:00
zep_memorystore.ipynb community[minor]: Add Zep Cloud components + docs + examples (#21671) 2024-05-27 12:50:13 -07:00
zilliz_cloud_pipeline.ipynb milvus: New langchain_milvus package and new milvus features (#21077) 2024-05-28 08:24:20 -07:00