Davide Menini b8baead70c fix (Html2TextTransformer): allow configuration of html2text (#9914) ...

Hi, this PR enables configuring the html2text package, instead of being
bound to use the hardcoded values. While simply passing `ignore_links`
and `ignore_images` to the `transform_documents` method was possible, I
preferred passing them to the `__init__` method for 2 reasons:

1. It is more efficient in case of subsequent calls to
`transform_documents`.
2. It allows to move the "complexity" to the instantiation, keeping the
actual execution simple and general enough. IMO the transformers should
all follow this pattern, allowing something like this:
```python
# Instantiate transformers
transformers = [
    TransformerA(foo='bar'),
    TransformerB(bar='foo'),
    # others
]

# During execution, call them sequentially
documents = ...
for tr in transformers:
    documents = tr.transform_documents(documents)
```

Thanks for the reviews!

---------

Co-authored-by: taamedag <Davide.Menini@swisscom.com>

2023-09-03 15:10:25 -07:00

..

experimental

Update __init__.py (#9955)

2023-09-03 15:02:58 -07:00

langchain

fix (Html2TextTransformer): allow configuration of html2text (#9914)

2023-09-03 15:10:25 -07:00