mirror of
https://github.com/hwchase17/langchain.git
synced 2026-04-05 11:55:58 +00:00
Deduplicate documents using MD5 of the page_content. Also allows for custom deduplication with graph ingestion method by providing metadata id attribute --------- Co-authored-by: Harrison Chase <hw.chase.17@gmail.com>