github/langchain
1
0
Fork 0
mirror of https://github.com/hwchase17/langchain.git synced 2025-10-31 16:08:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,211 Commits 1,039 Branches 1,060 Tags
ad7f4c03170380353ede101c3673878ea72c035f
Commit Graph

3 Commits

Author SHA1 Message Date
Eugene Yurtsev
e46202829f feat #4479: TextLoader auto detect encoding and improved exceptions (#4927) 
# TextLoader auto detect encoding and enhanced exception handling

- Add an option to enable encoding detection on `TextLoader`. 
- The detection is done using `chardet`
- The loading is done by trying all detected encodings by order of
confidence or raise an exception otherwise.

### New Dependencies:
- `chardet`

Fixes #4479 

## Before submitting

<!-- If you're adding a new integration, include an integration test and
an example notebook showing its use! -->

## Who can review?

Community members can review the PR once tests pass. Tag
maintainers/contributors who might be interested:

- @eyurtsev

---------

Co-authored-by: blob42 <spike@w530>
 2023-05-18 09:55:14 -04:00
Harrison Chase
44ae673388 Harrison/multithreading directory loader (#4650) 
Co-authored-by: PawelFaron <42373772+PawelFaron@users.noreply.github.com>
Co-authored-by: Pawel Faron <ext-pawel.faron@vaisala.com>
 2023-05-13 21:46:02 -07:00
Leonid Ganeline
59204a5033 docs: document_loaders improvements (#4200) 
- made notebooks consistent: titles, service/format descriptions.
- corrected short names to full names, for example, `Word` -> `Microsoft
Word`
- added missed descriptions
- renamed notebook files to make ToC correctly sorted
 2023-05-05 17:44:54 -07:00