Javier Martinez
21d42fd97a
feat: code execution v4 ( #2295 )
...
* feat: add bundle to remove
* fix: spaces
* feat: add xml render as skill spec
* feat: add skill volume root to cache
* fix: deduplicate values
* fix: change the mount path to skill_id
* fix: use different paths
* feat: add principal
(cherry picked from commit 5db64fe721d5706440ce9f342b1388ffe742bc16)
# Conflicts:
# private_gpt/components/code_execution/base.py
# private_gpt/components/code_execution/code_execution_component.py
# private_gpt/components/code_execution/local.py
# private_gpt/components/environment/manager.py
# private_gpt/components/tools/builders/bash_tool_builder.py
# private_gpt/components/tools/builders/text_editor_tool_builder.py
# private_gpt/components/tools/processors/bash_processor.py
* fix: mypy
...
* fix: config
* fix: sandbox config
* feat: add forward cookies
* fix: loop
* feat: add present server
* feat: add feature flag for tools
* refactor: move principal to another better place
* feat: add api key principal
* docs: fix docs
* docs: add present server
* fix: principal
* fix: mypy
* fix: avoid to block the loop
* fix: blocks in expansion
* fix: remove maximum concurrent users
...
* fix: multiplexer
* fix: readers
* fix: more fixes
...
* fix: impl
* feat: tool scheduler
* feat: add adaptative
* feat: add chat worker
* fix: config
* fix: max
* feat: add chat/tools workers
* fix: mypy
* feat: add generic scheduler
* fix: get result
* feat: do serializable the tool executor
* fix: tools
* fix: config
* fix: config
* fix: args
* fix: config
* fix: serializer
* Revert "fix: blocks in expansion"
This reverts commit a2110f94a8175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Handle PGPT_WORKER_MODE=celery in health check worker status
* fix: cancel
* fix: arch
* fix: test ingestion
* fix: deserialization of chat messages
* fix: broken results
* fix: mypy
* fix: test
* fix: config
* fix: remove arq tool worker
* fix: output cls
* fix: preserve early resumable tool callbacks
* fix: preserve async tool result order
* refactor: address worker PR review comments
* fix: mypy
* test: colocate ARQ chat enqueue coverage
* fix: remove redis from tests
* fix: mypy
* fix: tests
* test: isolate chat mocks and cancellation timing
* fix: tests
* fix: tests
* fix: test
(cherry picked from commit f8ee460af21115ff2349175728472+Copilot@users.noreply.github.com >
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
2026-07-15 13:05:23 +02:00
Javier Martinez
cd8ca2214a
feat: resumable chat worker + tool worker + async tokenizer ( #2298 )
...
* fix: avoid to block the loop
* fix: blocks in expansion
* fix: remove maximum concurrent users
...
* fix: multiplexer
* fix: readers
* fix: more fixes
...
* fix: impl
* feat: tool scheduler
* feat: add adaptative
* feat: add chat worker
* fix: max
* feat: add chat/tools workers
* fix: mypy
* feat: add generic scheduler
* fix: get result
* feat: do serializable the tool executor
* fix: tools
* fix: config
* fix: config
* fix: args
* fix: config
* fix: serializer
* Revert "fix: blocks in expansion"
This reverts commit a2110f94a8175728472+Copilot@users.noreply.github.com >
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* Handle PGPT_WORKER_MODE=celery in health check worker status
* fix: cancel
* fix: arch
* fix: test ingestion
* fix: deserialization of chat messages
* fix: broken results
* fix: mypy
* fix: test
* fix: config
* fix: remove arq tool worker
* fix: output cls
* fix: preserve early resumable tool callbacks
* fix: preserve async tool result order
* refactor: address worker PR review comments
* fix: mypy
* test: colocate ARQ chat enqueue coverage
* fix: remove redis from tests
* test: isolate chat mocks and cancellation timing
* fix: tests
(cherry picked from commit 218b599c66fc5ec0f72a1371c275a1175728472+Copilot@users.noreply.github.com >
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
2026-07-15 12:12:45 +02:00
Javier Martinez
bcadb418f3
docs: add community forks ( #2290 )
2026-07-06 11:20:32 +02:00
Javier Martinez
603152a62a
docs: code execution ( #2279 )
...
* fix: preview
* docs: add doc
2026-06-29 18:32:01 +02:00
Alfonso Lozana
78a1e8b9f6
feat: control docs parser ( #2273 )
...
* fix: ensure that the publisher is ready to publish new messages
* fix: dockerfile
* fix: clones
(cherry picked from commit bc0a77e050175728472+Copilot@users.noreply.github.com >
* fix: add ExtractionUnsuccessfulError in docling reader
* feat: add vision pipeline
* feat: add fall back with vision
* feat: add settings of enable_vision_fallback
* doc: update doc
* chore: code refactor
* feat: remove pypdfium2 dependency
* fix: add settings and change only doc vision behaviour
* feat: change extraction_type_override to skip_strategy_inference (disable strategy on vision transform parser)
* chore: make check
---------
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-06-24 08:22:17 +02:00
Javier Martinez
4021cf4e20
fix: use PGPT_HOME for local data, caches, and cleanup paths ( #2267 )
...
* feat: use default user folder
* docs: update references to local paths
* fix: windows
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
* fix: align make test and wipe with PGPT_HOME paths
* fix: align wipe target with PGPT_HOME local_data
* fix: folders
---------
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
2026-06-10 09:06:02 +02:00
Daniel Gallego Vico
349cec5a64
Main README update
2026-06-03 17:12:04 +02:00
Javier Martinez
80ff34b423
docs: add required libraries ( #2256 )
...
* docs: add instructions to install deps
* docs: update order
2026-06-03 15:44:59 +02:00
Javier Martinez
a6ab856c2b
fix: claude desktop after changes yesterday ( #2245 )
...
* fix: claude desktop after changes yesterday
* Potential fix for pull request finding
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-06-03 09:55:59 +02:00
Alfonso Lozana
53ea754fb3
docs: add python version ( #2241 )
2026-06-02 21:04:17 +02:00
Javier Martinez
65f717e046
docs: fix index url ( #2238 )
...
(cherry picked from commit 6eb12d658f04e89b7b512a362f083418023cde2f)
2026-06-02 20:40:40 +02:00
Javier Martinez
8a5c36725d
docs: fix broken links ( #2236 )
...
* chore: add docs redirects
(cherry picked from commit 29fec7af0e175728472+Copilot@users.noreply.github.com >
* docs: update index link
---------
Co-authored-by: Alfonso Lozana <alfonsolozana@gmail.com >
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com >
2026-06-02 20:20:09 +02:00
Javier Martinez
183cd03857
feat!: PrivateGPT revamp v1 ( #2230 )
...
* feat!: PrivateGPT revamp v1
* chore(docs): update nodejs
2026-06-02 16:55:46 +02:00
Javier Martinez
4ca6d0cb55
fix: add numpy issue to troubleshooting ( #2048 )
...
* docs: add numpy issue to troubleshooting
* fix: troubleshooting link
...
2024-08-07 12:16:03 +02:00
Javier Martinez
f09f6dd255
fix: add built image from DockerHub ( #2042 )
...
* chore: update docker-compose with profiles
* docs: add quick start doc
* chore: generate docker release when new version is released
* chore: add dockerhub image in docker-compose
* docs: update quickstart with local/remote images
* chore: update docker tag
* chore: refactor dockerfile names
* chore: update docker-compose names
* docs: update llamacpp naming
* fix: naming
* docs: fix llamacpp command
2024-08-05 17:15:38 +02:00
Javier Martinez
dae0727a1b
fix(deploy): improve Docker-Compose and quickstart on Docker ( #2037 )
...
* chore: update docker-compose with profiles
* docs: add quick start doc
2024-08-05 16:28:19 +02:00
Javier Martinez
50b3027a24
docs: update docs and capture ( #2029 )
...
* docs: update Readme
* style: refactor image
* docs: change important to tip
2024-08-01 10:01:22 +02:00
Javier Martinez
8119842ae6
feat(recipe): add our first recipe Summarize ( #2028 )
...
* feat: add summary recipe
* test: add summary tests
* docs: move all recipes docs
* docs: add recipes and summarize doc
* docs: update openapi reference
* refactor: split method in two method (summary)
* feat: add initial summarize ui
* feat: add mode explanation
* fix: mypy
* feat: allow to configure async property in summarize
* refactor: move modes to enum and update mode explanations
* docs: fix url
* docs: remove list-llm pages
* docs: remove double header
* fix: summary description
2024-07-31 16:53:27 +02:00
Javier Martinez
40638a18a5
fix: unify embedding models ( #2027 )
...
* feat: unify embedding model to nomic
* docs: add embedding dimensions mismatch
* docs: fix fern
2024-07-31 14:35:46 +02:00
Javier Martinez
9027d695c1
feat: make llama3.1 as default ( #2022 )
...
* feat: change ollama default model to llama3.1
* chore: bump versions
* feat: Change default model in local mode to llama3.1
* chore: make sure last poetry version is used
* fix: mypy
* fix: do not add BOS (with last llamacpp-python version)
2024-07-31 14:35:36 +02:00
Javier Martinez
e54a8fe043
fix: prevent to ingest local files (by default) ( #2010 )
...
* feat: prevent to local ingestion (by default) and add white-list
* docs: add local ingestion warning
* docs: add missing comment
* fix: update exception error
* fix: black
2024-07-31 14:33:46 +02:00
Javier Martinez
20bad17c98
feat(llm): autopull ollama models ( #2019 )
...
* chore: update ollama (llm)
* feat: allow to autopull ollama models
* fix: mypy
* chore: install always ollama client
* refactor: check connection and pull ollama method to utils
* docs: update ollama config with autopulling info
2024-07-29 13:25:42 +02:00
Iván Martínez
05a986231c
Add proper param to demo urls ( #2007 )
2024-07-22 14:44:03 +02:00
Javier Martinez
b62669784b
docs: update welcome page ( #2004 )
2024-07-18 14:42:39 +02:00
Jackson
43cc31f740
feat(vectordb): Milvus vector db Integration ( #1996 )
...
* integrate Milvus into Private GPT
* adjust milvus settings
* update doc info and reformat
* adjust milvus initialization
* adjust import error
* mionr update
* adjust format
* adjust the db storing path
* update doc
2024-07-18 10:55:45 +02:00
Javier Martinez
4523a30c8f
feat(docs): update documentation and fix preview-docs ( #2000 )
...
* docs: add missing configurations
* docs: change HF embeddings by ollama
* docs: add disclaimer about Gradio UI
* docs: improve readability in concepts
* docs: reorder `Fully Local Setups`
* docs: improve setup instructions
* docs: prevent have duplicate documentation and use table to show different options
* docs: rename privateGpt to PrivateGPT
* docs: update ui image
* docs: remove useless header
* docs: convert to alerts ingestion disclaimers
* docs: add UI alternatives
* docs: reference UI alternatives in disclaimers
* docs: fix table
* chore: update doc preview version
* chore: add permissions
* chore: remove useless line
* docs: fixes
...
2024-07-18 10:06:51 +02:00
Javier Martinez
01b7ccd064
fix(config): make tokenizer optional and include a troubleshooting doc ( #1998 )
...
* docs: add troubleshooting
* fix: pass HF token to setup script and prevent to download tokenizer when it is empty
* fix: improve log and disable specific tokenizer by default
* chore: change HF_TOKEN environment to be aligned with default config
* ifx: mypy
2024-07-17 10:06:27 +02:00
Javier Martinez
15f73dbc48
docs: update repo links, citations ( #1990 )
...
* docs: update project links
...
* docs: update citation
2024-07-09 10:03:57 +02:00
Marco Braga
dde02245bc
fix(docs): Fix concepts.mdx referencing to installation page ( #1779 )
...
* Fix/update concepts.mdx referencing to installation page
The link for `/installation` is broken in the "Main Concepts" page.
The correct path would be `./installation` or maybe `/installation/getting-started/installation`
* fix: docs
---------
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com >
2024-07-08 16:19:50 +02:00
Mart
067a5f144c
feat(docs): Fix setup docu ( #1926 )
...
* Update settings.mdx
* docs: add cmd
---------
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com >
2024-07-08 16:19:16 +02:00
Proger666
2612928839
feat(vectorstore): Add clickhouse support as vectore store ( #1883 )
...
* Added ClickHouse vector sotre support
* port fix
* updated lock file
* fix: mypy
* fix: mypy
---------
Co-authored-by: Valery Denisov <valerydenisov@double.cloud >
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com >
2024-07-08 16:18:22 +02:00
uw4
fc13368bc7
feat(llm): Support for Google Gemini LLMs and Embeddings ( #1965 )
...
* Support for Google Gemini LLMs and Embeddings
Initial support for Gemini, enables usage of Google LLMs and embedding models (see settings-gemini.yaml)
Install via
poetry install --extras "llms-gemini embeddings-gemini"
Notes:
* had to bump llama-index-core to later version that supports Gemini
* poetry --no-update did not work: Gemini/llama_index seem to require more (transient) updates to make it work...
* fix: crash when gemini is not selected
* docs: add gemini llm
---------
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com >
2024-07-08 11:47:36 +02:00
Shengsheng Huang
19a7c065ef
feat(docs): update doc for ipex-llm ( #1968 )
2024-07-08 09:42:44 +02:00
Fran García
d13029a046
feat(docs): add privategpt-ts sdk ( #1924 )
2024-05-10 14:13:15 +02:00
Daniel Gallego Vico
c1802e7cf0
fix(docs): Update installation.mdx ( #1866 )
...
Update repo url
2024-04-19 17:10:58 +02:00
Иван
8a836e4651
feat(docs): Add guide Llama-CPP Linux AMD GPU support ( #1782 )
2024-04-02 16:55:05 +02:00
machatschek
83adc12a8e
feat(RAG): Introduce SentenceTransformer Reranker ( #1810 )
2024-04-02 10:29:51 +02:00
Iván Martínez
572518143a
feat(docs): Feature/upgrade docs ( #1741 )
...
* Upgrade fern version
* Add info about SDKs
2024-03-19 21:26:53 +01:00
Brett England
134fc54d7d
feat(ingest): Created a faster ingestion mode - pipeline ( #1750 )
...
* Unify pgvector and postgres connection settings
* Remove local changes
* Update file pgvector->postgres
* postgresql should be postgres
* Adding pipeline ingestion mode
* disable hugging face parallelism. Continue on file to doc transform failure
* Semaphore to limit docq async workers. ETA reporting
2024-03-19 21:24:46 +01:00
Otto L
1efac6a3fe
feat(llm - embed): Add support for Azure OpenAI ( #1698 )
...
* Add support for Azure OpenAI
* fix: wrong default api_version
Should be dashes instead of underscores.
see: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference
* fix: code styling
applied "make check" changes
* refactor: extend documentation
* mention azopenai as available option and extras
* add recommended section
* include settings-azopenai.yaml configuration file
* fix: documentation
2024-03-15 16:49:50 +01:00
Brett England
258d02d87c
fix(docs): Minor documentation amendment ( #1739 )
...
* Unify pgvector and postgres connection settings
* Remove local changes
* Update file pgvector->postgres
* postgresql should be postgres
2024-03-15 16:36:32 +01:00
Brett England
63de7e4930
feat: unify settings for vector and nodestore connections to PostgreSQL ( #1730 )
...
* Unify pgvector and postgres connection settings
* Remove local changes
* Update file pgvector->postgres
2024-03-15 09:55:17 +01:00
Brett England
68b3a34b03
feat(nodestore): add Postgres for the doc and index store ( #1706 )
...
* Adding Postgres for the doc and index store
* Adding documentation. Rename postgres database local->simple. Postgres storage dependencies
* Update documentation for postgres storage
* Renaming feature to nodestore
* update docstore -> nodestore in doc
* missed some docstore changes in doc
* Updated poetry.lock
* Formatting updates to pass ruff/black checks
* Correction to unreachable code!
* Format adjustment to pass black test
* Adjust extra inclusion name for vector pg
* extra dep change for pg vector
* storage-postgres -> storage-nodestore-postgres
* Hash change on poetry lock
2024-03-14 17:12:33 +01:00
Iván Martínez
45f05711eb
feat: Upgrade to LlamaIndex to 0.10 ( #1663 )
...
* Extract optional dependencies
* Separate local mode into llms-llama-cpp and embeddings-huggingface for clarity
* Support Ollama embeddings
* Upgrade to llamaindex 0.10.14. Remove legacy use of ServiceContext in ContextChatEngine
* Fix vector retriever filters
2024-03-06 17:51:30 +01:00
TQ
cd40e3982b
feat(Vector): support pgvector ( #1624 )
2024-02-20 15:29:26 +01:00
Ygal Blum
6bbec79583
feat(llm): Add support for Ollama LLM ( #1526 )
2024-02-09 15:50:50 +01:00
CognitiveTech
e326126d0d
feat: add mistral + chatml prompts ( #1426 )
2024-01-16 22:51:14 +01:00
Guido Schulz
0a89d76cc5
fix(docs): Update quickstart doc and set version in pyproject.toml to 0.2.0
2023-12-26 13:09:31 +01:00
Matthew Hill
2d27a9f956
feat(llm): Add openailike llm mode ( #1447 )
...
This mode behaves the same as the openai mode, except that it allows setting custom models not
supported by OpenAI. It can be used with any tool that serves models from an OpenAI compatible API.
Implements #1424
2023-12-26 10:26:08 +01:00
Iván Martínez
8ec7cf49f4
feat(settings): Update default model to TheBloke/Mistral-7B-Instruct-v0.2-GGUF ( #1415 )
...
* Update LlamaCPP dependency
* Default to TheBloke/Mistral-7B-Instruct-v0.2-GGUF
* Fix API docs
2023-12-17 16:11:08 +01:00
