community[minor]: Add ITREX optimized Embeddings (#18474)

Introduction
[Intel® Extension for
Transformers](https://github.com/intel/intel-extension-for-transformers)
is an innovative toolkit designed to accelerate GenAI/LLM everywhere
with the optimal performance of Transformer-based models on various
Intel platforms

Description

adding ITREX runtime embeddings using intel-extension-for-transformers.
added mdx documentation and example notebooks
added embedding import testing.

---------

Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Co-authored-by: Bagatur <baskaryan@gmail.com>
This commit is contained in:
yuwenzho
2024-03-27 00:22:06 -07:00
committed by GitHub
parent 1fe10a3e3d
commit 3a7d2cf443
7 changed files with 365 additions and 26 deletions

View File

@@ -65,6 +65,7 @@ EXPECTED_ALL = [
"QuantizedBiEncoderEmbeddings",
"NeMoEmbeddings",
"SparkLLMTextEmbeddings",
"QuantizedBgeEmbeddings",
"PremAIEmbeddings",
"YandexGPTEmbeddings",
]