github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-03 20:16:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[minor]: Implement lazy_load() for ArxivLoader (#18664)

Browse Source 
Integration tests: `tests/integration_tests/utilities/test_arxiv.py` and
`tests/integration_tests/document_loaders/test_arxiv.py`
This commit is contained in:
Christophe Bornet
2024-03-06 15:16:49 +01:00
committed by GitHub
parent 2d96803ddd
commit 1100f8de7a
2 changed files with 22 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
libs/community/langchain_community/document_loaders/arxiv.py
View File

@@ -1,4 +1,4 @@
from typing import Any, List, Optional
from typing import Any, Iterator, List, Optional
from langchain_core.documents import Document
@@ -23,8 +23,8 @@ class ArxivLoader(BaseLoader):
doc_content_chars_max=doc_content_chars_max, **kwargs
)
def load(self) -> List[Document]:
return self.client.load(self.query)
def lazy_load(self) -> Iterator[Document]:
yield from self.client.lazy_load(self.query)
def get_summaries_as_docs(self) -> List[Document]:
return self.client.get_summaries_as_docs(self.query)