github/privateGPT
1
0
Fork 1
mirror of https://github.com/imartinez/privateGPT.git synced 2025-09-24 20:48:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat(settings): Update default model to TheBloke/Mistral-7B-Instruct-v0.2-GGUF (#1415)

Browse Source 
* Update LlamaCPP dependency

* Default to TheBloke/Mistral-7B-Instruct-v0.2-GGUF

* Fix API docs
This commit is contained in:
Iván Martínez
2023-12-17 16:11:08 +01:00
committed by GitHub
parent c71ae7cee9
commit 8ec7cf49f4
5 changed files with 1433 additions and 1233 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
fern/docs/pages/overview/welcome.mdx
View File

@@ -32,21 +32,6 @@ The installation guide will help you in the [Installation section](/installation
/>
</Cards>
## API Organization
The API is divided in two logical blocks:
1. High-level API, abstracting all the complexity of a RAG (Retrieval Augmented Generation) pipeline implementation:
- Ingestion of documents: internally managing document parsing, splitting, metadata extraction,
embedding generation and storage.
- Chat & Completions using context from ingested documents: abstracting the retrieval of context, the prompt
engineering and the response generation.
2. Low-level API, allowing advanced users to implement their own complex pipelines:
- Embeddings generation: based on a piece of text.
- Contextual chunks retrieval: given a query, returns the most relevant chunks of text from the ingested
documents.
<Callout intent = "info">
A working **Gradio UI client** is provided to test the API, together with a set of useful tools such as bulk
model download script, ingestion script, documents folder watch, etc.