langchain/libs
Shengsheng Huang fd1061e7bf
community[patch]: add more data types support to ipex-llm llm integration (#20833)
- **Description**:  
- **add support for more data types**: by default `IpexLLM` will load
the model in int4 format. This PR adds more data types support such as
`sym_in5`, `sym_int8`, etc. Data formats like NF3, NF4, FP4 and FP8 are
only supported on GPU and will be added in future PR.
    - Fix a small issue in saving/loading, update api docs
- **Dependencies**: `ipex-llm` library
- **Document**: In `docs/docs/integrations/llms/ipex_llm.ipynb`, added
instructions for saving/loading low-bit model.
- **Tests**: added new test cases to
`libs/community/tests/integration_tests/llms/test_ipex_llm.py`, added
config params.
- **Contribution maintainer**: @shane-huang
2024-04-25 12:58:18 -07:00
..
cli cli[minor]: Add __version__ (#20903) 2024-04-25 15:51:33 -04:00
community community[patch]: add more data types support to ipex-llm llm integration (#20833) 2024-04-25 12:58:18 -07:00
core core, community: deprecate tool.__call__ (#20900) 2024-04-25 14:50:39 -04:00
experimental experimental[patch]: Makes regex customizable in text_splitter.py (SemanticChunker class) (#20485) 2024-04-25 00:32:40 +00:00
langchain core[minor], langchain[patch], community[patch]: mv StructuredQuery (#20849) 2024-04-25 09:40:26 -07:00
partners mistral, openai: support custom tokenizers in chat models (#20901) 2024-04-25 15:23:29 -04:00
standard-tests standard-tests: split tool calling test (#20803) 2024-04-23 20:59:45 +00:00
text-splitters text-splitters[patch]: fix MarkdownHeaderTextSplitter fails to parse headers with non-printable characters (#20645) 2024-04-25 00:07:42 +00:00