feat:embedding api

1.embedding_engine add source_reader param
2.docs update
3.fix chroma exit bug
This commit is contained in:
aries_ckt
2023-07-13 15:45:25 +08:00
parent 56c1947eda
commit 6404bfe63a
15 changed files with 100 additions and 36 deletions

View File

@@ -25,22 +25,25 @@ $ docker run --name=mysql -p 3306:3306 -e MYSQL_ROOT_PASSWORD=aa12345678 -dit my
We use [Chroma embedding database](https://github.com/chroma-core/chroma) as the default for our vector database, so there is no need for special installation. If you choose to connect to other databases, you can follow our tutorial for installation and configuration.
For the entire installation process of DB-GPT, we use the miniconda3 virtual environment. Create a virtual environment and install the Python dependencies.
```{tip}
```bash
python>=3.10
conda create -n dbgpt_env python=3.10
conda activate dbgpt_env
pip install -r requirements.txt
```
Before use DB-GPT Knowledge Management
```{tip}
```bash
python -m spacy download zh_core_web_sm
```
Once the environment is installed, we have to create a new folder "models" in the DB-GPT project, and then we can put all the models downloaded from huggingface in this directory
Notice make sure you have install git-lfs
```{tip}
Notice make sure you have install git-lfs
```
```bash
git clone https://huggingface.co/Tribbiani/vicuna-13b
git clone https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
git clone https://huggingface.co/GanymedeNil/text2vec-large-chinese

View File

@@ -4,11 +4,13 @@ DB-GPT provides a third-party Python API package that you can integrate into you
### Installation from Pip
You can simply pip install:
```{tip}
```bash
pip install -i https://pypi.org/ db-gpt==0.3.0
```
Notice:make sure python>=3.10
```{tip}
Notice:make sure python>=3.10
```
### Environment Setup
@@ -16,8 +18,11 @@ By default, if you use the EmbeddingEngine api
you will prepare embedding models from huggingface
Notice make sure you have install git-lfs
```{tip}
Notice make sure you have install git-lfs
```
```bash
git clone https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2
git clone https://huggingface.co/GanymedeNil/text2vec-large-chinese