langchain/docs/docs/integrations/retrievers
Ayo Ayibiowu ac1d7d9de8
community[feat]: Adds LLMLingua as a document compressor (#17711)
**Description**: This PR adds support for using the [LLMLingua project
](https://github.com/microsoft/LLMLingua) especially the LongLLMLingua
(Enhancing Large Language Model Inference via Prompt Compression) as a
document compressor / transformer.

The LLMLingua project is an interesting project that can greatly improve
RAG system by compressing prompts and contexts while keeping their
semantic relevance.

**Issue**: https://github.com/microsoft/LLMLingua/issues/31
**Dependencies**: [llmlingua](https://pypi.org/project/llmlingua/)

@baskaryan

---------

Co-authored-by: Ayodeji Ayibiowu <ayodeji.ayibiowu@getinge.com>
Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>
2024-02-27 19:23:56 -08:00
..
self_query partners: add Elasticsearch package (#17467) 2024-02-26 23:19:47 +00:00
activeloop.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00
amazon_kendra_retriever.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
arcee.ipynb notebook fmt (#12498) 2023-10-29 15:50:09 -07:00
arxiv.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
azure_cognitive_search.ipynb Fix typos (#11663) 2023-10-12 11:44:03 -04:00
bedrock.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
bm25.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00
breebs.ipynb community[minor]: Breebs docs retriever (#16578) 2024-02-05 15:51:08 -08:00
chaindesk.ipynb Restructure docs (#11620) 2023-10-10 12:55:19 -07:00
chatgpt-plugin.ipynb docs, experimental[patch], langchain[patch], community[patch]: update storage imports (#15429) 2024-01-02 16:47:11 -05:00
cohere-reranker.ipynb docs: Update cohere rerank and comparison docs (#16198) 2024-01-23 19:39:42 -08:00
cohere.ipynb docs, community[patch], experimental[patch], langchain[patch], cli[pa… (#15412) 2024-01-02 15:32:16 -05:00
docarray_retriever.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
elastic_search_bm25.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
embedchain.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
flashrank-reranker.ipynb community[minor]: add FlashRank ranker (#16785) 2024-02-12 20:00:52 -08:00
fleet_context.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00
google_drive.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
google_vertex_ai_search.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
jaguar.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
kay.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
knn.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
llmlingua.ipynb community[feat]: Adds LLMLingua as a document compressor (#17711) 2024-02-27 19:23:56 -08:00
merger_retriever.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
metal.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
outline.ipynb docs: more pip installs (#15771) 2024-01-12 18:16:00 -08:00
pinecone_hybrid_search.ipynb pinecone[patch], docs: PineconeVectorStore, release 0.0.3 (#17896) 2024-02-22 08:24:08 -08:00
pubmed.ipynb Restructure docs (#11620) 2023-10-10 12:55:19 -07:00
qdrant-sparse.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
ragatouille.ipynb update ragatouille integration (#15658) 2024-01-07 10:51:34 -08:00
re_phrase.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
sec_filings.ipynb docs: langchain-openai (#15513) 2024-01-06 15:54:48 -08:00
singlestoredb.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
svm.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
tavily.ipynb update ragatouille integration (#15658) 2024-01-07 10:51:34 -08:00
tf_idf.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00
vespa.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
weaviate-hybrid.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00
wikipedia.ipynb docs: integration package pip installs (#15762) 2024-01-09 11:13:10 -08:00
you-retriever.ipynb community: Add you.com utility, update you retriever integration docs (#17014) 2024-02-08 13:47:50 -08:00
zep_memorystore.ipynb docs, templates: update schema imports to core (#17885) 2024-02-22 15:58:44 -08:00