langchain/docs
Zend bd4865b6fe
Async Recursive URL loader (#8502)
Description: This PR improves the function of recursive_url_loader, such
as limiting the depth of the access, and customizable extractors(from
the raw webpage to the text of the Document object), so that users can
use other tools to extract the webpage. This PR also includes the
document and test for the new loader.
Old PR closed due to project structure change. #7756

Because socket requests are not allowed, the old unit test was removed.
Issue: N/A
Dependencies: asyncio, aiohttp
Tag maintainer: @rlancemartin
Twitter handle: @ Zend_Nihility

---------

Co-authored-by: Lance Martin <lance@langchain.dev>
2023-08-06 16:22:31 -07:00
..
api_reference rm sklearn links (#8773) 2023-08-04 14:28:00 -07:00
docs_skeleton docs: Improvements on Mendable Search (#8808) 2023-08-06 15:32:06 -07:00
extras Async Recursive URL loader (#8502) 2023-08-06 16:22:31 -07:00
snippets Update documentation for prompts (#8381) 2023-08-04 14:25:03 -07:00
.local_build.sh Update local script for docs build (#8377) 2023-07-27 13:13:59 -07:00
package-lock.json docs: New experimental UI for Mendable Search (#6558) 2023-07-03 20:52:13 +01:00
vercel_requirements.txt Add api cross ref linking (#8275) 2023-07-26 12:38:58 -07:00