github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-09-08 22:42:05 +00:00
Code Issues Packages Projects Releases Wiki Activity

community[minor]: Firecrawl.dev integration (#20364)

Browse Source 
Added the [FireCrawl](https://firecrawl.dev) document loader. Firecrawl
crawls and convert any website into LLM-ready data. It crawls all
accessible subpages and give you clean markdown for each.

    - **Description:** Adds FireCrawl data loader
    - **Dependencies:** firecrawl-py
    - **Twitter handle:** @mendableai 

ccing contributors: (@ericciarla @nickscamara)

---------

Co-authored-by: Bagatur <baskaryan@gmail.com>
Co-authored-by: Bagatur <22008038+baskaryan@users.noreply.github.com>
This commit is contained in:
Nicolas
2024-04-12 15:13:48 -04:00
committed by GitHub
parent a1b105ac00
commit ad04585e30
6 changed files with 295 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
libs/community/tests/unit_tests/document_loaders/test_imports.py
View File

@@ -65,6 +65,7 @@ EXPECTED_ALL = [
"FaunaLoader",
"FigmaFileLoader",
"FileSystemBlobLoader",
"FireCrawlLoader",
"GCSDirectoryLoader",
"GCSFileLoader",
"GeoDataFrameLoader",