mirror of
https://github.com/hwchase17/langchain.git
synced 2025-05-12 18:47:21 +00:00
ae28568e2a
Description: This PR adds embeddings for LocalAI ( https://github.com/go-skynet/LocalAI ), a self-hosted OpenAI drop-in replacement. As LocalAI can re-use OpenAI clients it is mostly following the lines of the OpenAI embeddings, however when embedding documents, it just uses string instead of sending tokens as sending tokens is best-effort depending on the model being used in LocalAI. Sending tokens is also tricky as token id's can mismatch with the model - so it's safer to just send strings in this case. Partly related to: https://github.com/hwchase17/langchain/issues/5256 Dependencies: No new dependencies Twitter: @mudler_it --------- Signed-off-by: mudler <mudler@localai.io> Co-authored-by: Bagatur <baskaryan@gmail.com> |
||
|---|---|---|
| .. | ||
| aleph_alpha.ipynb | ||
| azureopenai.ipynb | ||
| bedrock.ipynb | ||
| clarifai.ipynb | ||
| cohere.ipynb | ||
| dashscope.ipynb | ||
| deepinfra.ipynb | ||
| elasticsearch.ipynb | ||
| embaas.ipynb | ||
| fake.ipynb | ||
| google_vertex_ai_palm.ipynb | ||
| gpt4all.ipynb | ||
| huggingfacehub.ipynb | ||
| index.mdx | ||
| instruct_embeddings.ipynb | ||
| jina.ipynb | ||
| llamacpp.ipynb | ||
| localai.ipynb | ||
| minimax.ipynb | ||
| modelscope_hub.ipynb | ||
| mosaicml.ipynb | ||
| nlp_cloud.ipynb | ||
| openai.ipynb | ||
| sagemaker-endpoint.ipynb | ||
| self-hosted.ipynb | ||
| sentence_transformers.ipynb | ||
| spacy_embedding.ipynb | ||
| tensorflowhub.ipynb | ||