langchain/docs/extras/integrations/document_loaders
mpb159753 7df2dfc4c2
Add Support for Loading Documents from Huawei OBS (#8573)
Description:
This PR adds support for loading documents from Huawei OBS (Object
Storage Service) in Langchain. OBS is a cloud-based object storage
service provided by Huawei Cloud. With this enhancement, Langchain users
can now easily access and load documents stored in Huawei OBS directly
into the system.

Key Changes:
- Added a new document loader module specifically for Huawei OBS
integration.
- Implemented the necessary logic to authenticate and connect to Huawei
OBS using access credentials.
- Enabled the loading of individual documents from a specified bucket
and object key in Huawei OBS.
- Provided the option to specify custom authentication information or
obtain security tokens from Huawei Cloud ECS for easy access.

How to Test:
1. Ensure the required package "esdk-obs-python" is installed.
2. Configure the endpoint, access key, secret key, and bucket details
for Huawei OBS in the Langchain settings.
3. Load documents from Huawei OBS using the updated document loader
module.
4. Verify that documents are successfully retrieved and loaded into
Langchain for further processing.

Please review this PR and let us know if any further improvements are
needed. Your feedback is highly appreciated!

@rlancemartin, @eyurtsev

---------

Co-authored-by: Bagatur <baskaryan@gmail.com>
2023-08-01 09:30:30 -07:00
..
example_data cleanup warnings (#8379) 2023-07-27 13:43:05 -07:00
acreom.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
airbyte_json.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
airtable.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
alibaba_cloud_maxcompute.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
apify_dataset.ipynb Update Integrations links (#8206) 2023-07-24 21:20:32 -07:00
arxiv.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
async_html.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
aws_s3_directory.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
aws_s3_file.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azlyrics.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azure_blob_storage_container.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
azure_blob_storage_file.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
bibtex.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
bilibili.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
blackboard.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
blockchain.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
brave_search.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
browserless.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
chatgpt_loader.ipynb Add api cross ref linking (#8275) 2023-07-26 12:38:58 -07:00
college_confidential.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
concurrent.ipynb Add ConcurrentLoader (#7512) 2023-07-31 17:56:31 -07:00
confluence.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
conll-u.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
copypaste.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
csv.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
cube_semantic.ipynb Extend Cube Semantic Loader functionality (#8186) 2023-07-24 12:11:58 -07:00
datadog_logs.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
diffbot.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
discord.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
docugami.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
dropbox.ipynb mv dropbox (#8438) 2023-07-28 16:07:56 -07:00
duckdb.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
email.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
embaas.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
epub.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
Etherscan.ipynb Fix typo in Etherscan.ipynb (#8340) 2023-07-27 01:57:19 -07:00
evernote.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
excel.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
facebook_chat.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
fauna.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
figma.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
geopandas.ipynb fix geopandas link (#8305) 2023-07-26 11:30:17 -07:00
git.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
gitbook.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
github.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_bigquery.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_cloud_storage_directory.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_cloud_storage_file.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
google_drive.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
grobid.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
gutenberg.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
hacker_news.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
huawei_obs_directory.ipynb Add Support for Loading Documents from Huawei OBS (#8573) 2023-08-01 09:30:30 -07:00
huawei_obs_file.ipynb Add Support for Loading Documents from Huawei OBS (#8573) 2023-08-01 09:30:30 -07:00
hugging_face_dataset.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
ifixit.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
image_captions.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
image.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
imsdb.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
index.mdx mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
iugu.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
joplin.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
jupyter_notebook.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
larksuite.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mastodon.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mediawikidump.ipynb Github add "Create PR" tool + Docs update (#8235) 2023-07-27 19:19:44 -07:00
merge_doc_loader.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
mhtml.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
microsoft_onedrive.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
microsoft_powerpoint.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
microsoft_word.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
modern_treasury.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
notion.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
notiondb.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
obsidian.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
odt.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
open_city_data.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
org_mode.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
pandas_dataframe.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
psychic.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
pyspark_dataframe.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
readthedocs_documentation.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
recursive_url_loader.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
reddit.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
roam.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
rockset.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
rst.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
sitemap.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
slack.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
snowflake.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
source_code.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
spreedly.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
stripe.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
subtitle.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
telegram.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
tencent_cos_directory.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
tencent_cos_file.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
tomarkdown.ipynb mv popular and additional chains to use cases (#8242) 2023-07-27 12:55:13 -07:00
toml.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
trello.ipynb added lxml to the pip install example since it is required (#8260) 2023-07-25 18:16:07 -07:00
tsv.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
twitter.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
unstructured_file.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
url.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
weather.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
web_base.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
whatsapp_chat.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
wikipedia.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
xml.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
xorbits.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
youtube_audio.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00
youtube_transcript.ipynb mv module integrations docs (#8101) 2023-07-23 23:23:16 -07:00