github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-06-03 13:43:24 +00:00
Code Issues Packages Projects Releases Wiki Activity

Resolve GHI 10674 (#10977)

Browse Source
This commit is contained in:
deanchanter 2023-09-23 19:11:52 -04:00 committed by GitHub
parent ff732e10f8
commit f945426874
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
libs/langchain/langchain/document_loaders/hugging_face_dataset.py
View File

@ -27,6 +27,10 @@ class HuggingFaceDatasetLoader(BaseLoader):
Args: Args:
path: Path or name of the dataset. path: Path or name of the dataset.
page_content_column: Page content column name. Default is "text". page_content_column: Page content column name. Default is "text".
Note: Currently the function assumes the content is a string.
If it is not download the dataset using huggingface library and convert
using the json or pandas loaders.
https://github.com/langchain-ai/langchain/issues/10674
name: Name of the dataset configuration. name: Name of the dataset configuration.
data_dir: Data directory of the dataset configuration. data_dir: Data directory of the dataset configuration.
data_files: Path(s) to source data file(s). data_files: Path(s) to source data file(s).