Ettore Di Giacinto ae28568e2a Add embeddings for LocalAI (#8134) ...

Description:

This PR adds embeddings for LocalAI (
https://github.com/go-skynet/LocalAI ), a self-hosted OpenAI drop-in
replacement. As LocalAI can re-use OpenAI clients it is mostly following
the lines of the OpenAI embeddings, however when embedding documents, it
just uses string instead of sending tokens as sending tokens is
best-effort depending on the model being used in LocalAI. Sending tokens
is also tricky as token id's can mismatch with the model - so it's safer
to just send strings in this case.

Partly related to: https://github.com/hwchase17/langchain/issues/5256

Dependencies: No new dependencies

Twitter: @mudler_it
---------

Signed-off-by: mudler <mudler@localai.io>
Co-authored-by: Bagatur <baskaryan@gmail.com>

2023-07-24 12:16:49 -07:00

..

experimental

bump lc241 exp3 (#8193)

2023-07-24 11:52:44 -07:00

langchain

Add embeddings for LocalAI (#8134)

2023-07-24 12:16:49 -07:00