Commit Graph

378 Commits

Author SHA1 Message Date
Alfonso Lozana
36c54c2408 feat: add chunks for bigs documents 2026-06-26 15:51:01 +02:00
Alfonso Lozana
b79c216bd5 feat: add vision parsing notifications of percentage 2026-06-26 13:01:34 +02:00
Javier Martinez
4cca7d0b97 feat: allow to attach files as Anthropic does (#2265)
* feat: add convert/parser service

(cherry picked from commit 2350ad0a3e60291fbb0ded1d1f1d1c784dcc6b3c)

* fix: mypy & test

(cherry picked from commit 4e5358ee156dc11400b6f1fdbcc71a58220a581c)

* feat: add initial content

(cherry picked from commit 6eaeb4f1a8e20ce09fb208aca8468185d3866e3c)

* fix: return content as tree

* docs: add convert examples

* feat: add parallel support

* feat: add concurrency in multimodal interceptor

* refactor: move config to a common class

* fix: apply preprocessors only over the last user message

* fix: final tweaks to allow to configure feature flag

* fix: support legacy blocks

* test: fix

* fix: mypy

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* fix: image/audio in the chat

* fix: copilot

* fix: name

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-25 15:35:46 +02:00
Javier Martinez
42a6c047d0 feat: add validation skill endpoint + skill prompt (#2272)
* feat: add skill validator endpoint

* fix: skills

* feat: add skill prompt

(cherry picked from commit c36d27f008)

# Conflicts:
#	private_gpt/chat/input_models.py
#	private_gpt/components/prompts/prompt_builder.py
#	private_gpt/server/chat/interceptors/platform_guidelines_interceptor.py

* fix: test

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* fix: clarify skill visibility comment

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* fix: rename has_loaded_non_eager variable to snake_case

* test: cover skill validation route

* test: fix invalid skill validation case

* test: cover skill tool visibility states

* feat: improve skill tools + prompt

* fix: mypy

* feat: allow to limit the skill maximum size

* feat: add validation error codes

* fix: tests

* fix: invalid frontmatter

* fix: edge cases

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
2026-06-25 15:35:26 +02:00
Alfonso Lozana
78a1e8b9f6 feat: control docs parser (#2273)
* fix: ensure that the publisher is ready to publish new messages

* fix: dockerfile

* fix: clones

(cherry picked from commit bc0a77e050)

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* fix: add ExtractionUnsuccessfulError in docling reader

* feat: add vision pipeline

* feat: add fall back with vision

* feat: add settings of enable_vision_fallback

* doc: update doc

* chore: code refactor

* feat: remove pypdfium2 dependency

* fix: add settings and change only doc vision behaviour

* feat: change extraction_type_override to skip_strategy_inference (disable strategy on vision transform parser)

* chore: make check

---------

Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-24 08:22:17 +02:00
Alfonso Lozana
5d60141f08 feat: improve web search (#2274)
* fix:[ZYL-3553] web scraper memory (#693)

* fix: web scraper memory

* chore: make check

chore: fix make check errors

chore: fix make check

fix: async_playwright for test

chore: fix  ruff check -

chore: try to fix mypy

chore: more fix...

chore: add playwright to evaluation

fix: mypy

Revert "chore: add playwright to evaluation"

This reverts commit d916b56dc144a405ae0ff0103d1b377764f1ecad.
# Conflicts:
#	private_gpt/components/tools/builders/web_fetch_builder.py
#	private_gpt/components/web/web_scraper_service.py
#	private_gpt/components/web/web_search/processors/clean_content.py
#	private_gpt/components/web/web_search/processors/select_best_links.py
#	private_gpt/components/web/web_search/web_search_service.py
#	private_gpt/server/tools/tool_service.py

* feat: improve web scraper pool (#695)

* feat: [ZYL-3673] web search improve quality (#697)

* feat: improve web scraper pool

* feat: improve select best links

* fix: add settings of context

* fix: brave config (#699)

---------

Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com>
2026-06-24 08:20:24 +02:00
dependabot[bot]
671eae37ae chore(deps): bump actions/checkout from 6 to 7 (#2275)
Bumps [actions/checkout](https://github.com/actions/checkout) from 6 to 7.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v6...v7)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-24 08:19:45 +02:00
zylon-ci
88d7e259a4 chore(main): release 1.0.1 (#2263)
* chore(main): release 1.0.1

* build: update uv.lock for 1.0.1

* docs: update OpenAPI spec for 1.0.1

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zylon CI <ci@zylon.ai>
v1.0.1
2026-06-18 15:55:36 +02:00
rokieg77-alt
a64f1c9cf0 perf(prompts): use date-level current_date to preserve prompt-prefix caching (#2271)
create_chat_header_prompt rendered current_date with sub-second
datetime.now().isoformat() into the system prompt header, before the
guidelines and retrieved-context blocks. Since it changes every request,
the system-prompt prefix is never byte-stable, which defeats LLM
prompt-prefix caching (OpenAI automatic prefix caching, Anthropic
cache_control, local KV-cache reuse).

Use date-level granularity; the model only needs the calendar date for
relative-date reasoning and the prefix stays stable within a day.

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-16 10:58:47 +02:00
Javier Martinez
4c0c500bbd fix: ensure that the publisher is ready to publish new messages (#2266)
* fix: ensure that the publisher is ready to publish new messages

* fix: dockerfile

* fix: clones

(cherry picked from commit bc0a77e050)

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-12 15:20:46 +02:00
dependabot[bot]
8ac84e3c35 chore(deps): bump astral-sh/setup-uv from 8.1.0 to 8.2.0 (#2268)
Bumps [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) from 8.1.0 to 8.2.0.
- [Release notes](https://github.com/astral-sh/setup-uv/releases)
- [Commits](08807647e7...fac544c07d)

---
updated-dependencies:
- dependency-name: astral-sh/setup-uv
  dependency-version: 8.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-10 09:06:59 +02:00
Javier Martinez
4021cf4e20 fix: use PGPT_HOME for local data, caches, and cleanup paths (#2267)
* feat: use default user folder

* docs: update references to local paths

* fix: windows

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* fix: align make test and wipe with PGPT_HOME paths

* fix: align wipe target with PGPT_HOME local_data

* fix: folders

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
2026-06-10 09:06:02 +02:00
github-actions[bot]
cfa12bb4c8 chore(deps): update Claude specs and anthropic SDK (#2262)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2026-06-08 13:51:49 +02:00
Javier Martinez
4302bd629a fix: add missing docker database deps (#2264)
* fix: update deps names in dockerfile

* fix: missing prefix
2026-06-08 13:50:24 +02:00
JulianS1987
c120a90603 fix: make embedding API key optional for local OpenAI-compatible engines (#2261)
Ingesting documents with a local OpenAI-compatible embedding engine (Ollama,
vLLM, ...) failed with `openai.OpenAIError: Missing credentials` when no API
key was configured. The OpenAI-like embedding factory forwarded an empty
api_key straight to the OpenAI client, which rejects empty credentials at
request time.

Chat already tolerates a missing key (completions/openailike.py uses
`... or "default"`) and so does the embedding discovery probe
(`... or "no-key"`); only the embedding factory lacked the fallback, so model
discovery and chat worked while the first real embedding call (ingestion)
crashed.

Mirror the chat behaviour with a placeholder key on the local
OpenAI-compatible path. The strict api.openai.com path is unchanged and still
requires a real key.

Fixes #2260

Co-authored-by: Julian Siegrist <jsiegrist@immomio.de>
2026-06-08 08:09:15 +02:00
github-actions[bot]
7595d25a4c chore(main): release 1.0.0 (#2231)
* chore(main): release 1.0.0

* build: update uv.lock for 1.0.0

* docs: update OpenAPI spec for 1.0.0

---------

Co-authored-by: zylon-ci <dev+ci@zylon.ai>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zylon CI <ci@zylon.ai>
v1.0.0
2026-06-03 17:25:13 +02:00
Daniel Gallego Vico
349cec5a64 Main README update 2026-06-03 17:12:04 +02:00
Javier Martinez
c438ba183f fix: citation/thinking prompts (#2257)
* fix: platform guidelines

(cherry picked from commit e341525b3ad5b3000bc5c6fd7b5f2d6ef90d8403)

* fix: remove dummy file

(cherry picked from commit 44b46758af7db803059831fb4bc57b15a486bf65)

* fix: tests

(cherry picked from commit 631d796175ab81f33f0e5bd264add3b1babf6743)
2026-06-03 17:00:13 +02:00
Javier Martinez
f0745cdcd4 style(ui): update favicon (#2258)
* style: update favicon

* fix: update favicon
2026-06-03 16:59:56 +02:00
Javier Martinez
80ff34b423 docs: add required libraries (#2256)
* docs: add instructions to install deps

* docs: update order
2026-06-03 15:44:59 +02:00
Iván Martínez
d1ac2e29ad feat: add markdown table renderer to the workbench ui (#2255) 2026-06-03 15:44:46 +02:00
Alfonso Lozana
f2e6685951 feat: change logo app (#2254)
* feat: change logo app

* feat: update logo style
2026-06-03 14:18:43 +02:00
dependabot[bot]
d257fbf228 chore(deps): bump actions/upload-artifact from 4 to 7 (#2251)
* chore(deps): bump actions/upload-artifact from 4 to 7

Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 4 to 7.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v4...v7)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

* chore: fix uv

(cherry picked from commit ce21cf3effed95c32213d325f3fece578feffec8)

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Javier Martinez <javiermartinezalvarez98@gmail.com>
2026-06-03 12:41:48 +02:00
dependabot[bot]
70254897f3 chore(deps): bump actions/checkout from 4 to 6 (#2250)
Bumps [actions/checkout](https://github.com/actions/checkout) from 4 to 6.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v4...v6)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-03 12:36:11 +02:00
dependabot[bot]
20cddb170c chore(deps): bump actions/download-artifact from 4 to 8 (#2253)
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4 to 8.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v4...v8)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-version: '8'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-03 12:32:36 +02:00
dependabot[bot]
20f0773a38 chore(deps): bump actions/setup-node from 4 to 6 (#2252)
Bumps [actions/setup-node](https://github.com/actions/setup-node) from 4 to 6.
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](https://github.com/actions/setup-node/compare/v4...v6)

---
updated-dependencies:
- dependency-name: actions/setup-node
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-03 12:31:44 +02:00
dependabot[bot]
b668e36ba6 chore(deps): bump actions/setup-python from 5 to 6 (#2249)
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 5 to 6.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](https://github.com/actions/setup-python/compare/v5...v6)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-version: '6'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-03 12:31:22 +02:00
dependabot[bot]
c049df1080 chore(deps): bump actions/github-script from 7 to 9 (#2248)
Bumps [actions/github-script](https://github.com/actions/github-script) from 7 to 9.
- [Release notes](https://github.com/actions/github-script/releases)
- [Commits](https://github.com/actions/github-script/compare/v7...v9)

---
updated-dependencies:
- dependency-name: actions/github-script
  dependency-version: '9'
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-06-03 12:31:00 +02:00
Javier Martinez
64b25ef43b chore: update github actions (#2247)
* chore: update release

* chore: add dependabot

* chore: update github action versions

* chore: update anthropic action to be weekly

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-03 12:18:22 +02:00
Javier Martinez
a6ab856c2b fix: claude desktop after changes yesterday (#2245)
* fix: claude desktop after changes yesterday

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-03 09:55:59 +02:00
Javier Martinez
feb11e45cb fix: update claude api spec (#2246)
* feat: allow to update claude api spec automatically

* feat: script to update sdk / openapi from claude

* feat: add xhigh reasoning

* feat: add mid system content block
2026-06-03 09:23:05 +02:00
Javier Martinez
3dbadc0b32 fix: ui auth header (#2242)
* fix: default ui path

(cherry picked from commit ceaa84249b50e17221d6d6720fe7af3f0d064272)

* style: use accordion instead plain block

(cherry picked from commit 103c0c3313a89553197d76c23d1b4ced29eb8e3b)
2026-06-03 06:53:07 +02:00
Javier Martinez
86ceea5de8 chore: don't allow to run worker without celery (#2243)
(cherry picked from commit 162b9087b4cf3fb66ae0c8ae465bd90e8dacc0f2)
2026-06-03 06:52:41 +02:00
Javier Martinez
aa5262154f fix: code agents (#2244)
* chore: fix opencode & claude code

(cherry picked from commit 3cc365c6b9178f3a63e85566594566965a4f25a9)

* chore: change default log to use only in server

(cherry picked from commit 333278a59c8bf22de5d7b579e7bad1316abeee1a)
2026-06-03 06:52:24 +02:00
Javier Martinez
e4d69a7efc chore: ignore issue (#2240)
* chore(script): add set version script

(cherry picked from commit a9cc3f9bc4)
(cherry picked from commit 9b7834e9ca)

* chore(mypy): fix

(cherry picked from commit ecd4369fef)
(cherry picked from commit 4ddfdf0fa6)

* chore: fix ignore

(cherry picked from commit 1d6736ba52)
2026-06-02 21:05:24 +02:00
Alfonso Lozana
53ea754fb3 docs: add python version (#2241) 2026-06-02 21:04:17 +02:00
Javier Martinez
e8d4ea3e36 chore: remove empty folders (#2239) 2026-06-02 20:42:17 +02:00
Javier Martinez
65f717e046 docs: fix index url (#2238)
(cherry picked from commit 6eb12d658f04e89b7b512a362f083418023cde2f)
2026-06-02 20:40:40 +02:00
Javier Martinez
e19cd87b24 ci: not run tests when no src changes (#2237)
* ci: not run tests when no src changes

* ci: update action
2026-06-02 20:25:42 +02:00
Javier Martinez
8a5c36725d docs: fix broken links (#2236)
* chore: add docs redirects

(cherry picked from commit 29fec7af0e)

* chore: fix links on doc

(cherry picked from commit ba56846b36a0e985e5efe5b38b09c1dfdf3e9acc)
(cherry picked from commit 2f86726aab656f12e809aa2bc83f67d8d08c83d8)

* fix: use current host instead hardcoded

(cherry picked from commit e32cac5afb13d49fba25101bd86afb1694044434)

* docs: fix links of doc

(cherry picked from commit 165f4c1a2abf65ba70ba2ba783ff644badfdf4a2)

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* docs: update index link

---------

Co-authored-by: Alfonso Lozana <alfonsolozana@gmail.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-02 20:20:09 +02:00
OrbisAI Security
27bd992387 fix: CVE-2026-35030 security vulnerability (#2232)
Automated dependency upgrade by OrbisAI Security
2026-06-02 20:05:18 +02:00
Javier Martinez
0475e69e5e chore: update dockerfile (#2234)
* chore(docker): fix entrypoint

(cherry picked from commit 9db9cb60b7)

* chore(docker): fix downloads

(cherry picked from commit 6777a9dca8c43033af9e158b53ea87eb9e4b1e31)

* chore(docker): fix missing nltk package

(cherry picked from commit acdabb957be98295d6d133100e781e2bcb4fbcb0)

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-06-02 19:52:20 +02:00
Javier Martinez
d3954dbb6f chore: update post update release (#2235)
* chore: fix uv lock after update

(cherry picked from commit 29137d673e)

* chore(docs): fix postupdate

(cherry picked from commit 3a6fb0179a1183ed60b8ca28bdff248aa1358df4)

* chore(docs): use node 24

(cherry picked from commit 3c30538a32)

* chore(build): copy version.txt

(cherry picked from commit bb1ea2f1d6)
2026-06-02 19:52:00 +02:00
Javier Martinez
183cd03857 feat!: PrivateGPT revamp v1 (#2230)
* feat!: PrivateGPT revamp v1

* chore(docs): update nodejs
2026-06-02 16:55:46 +02:00
Iván Martínez
7effd57c84 Update README.md 2026-02-26 10:56:48 +01:00
Iván Martínez
010211f02c Update README.md 2026-02-26 10:54:27 +01:00
Iván Martínez
b7ee43788d Update README.md 2024-11-13 20:29:56 +01:00
meng-hui
940bdd49af fix: 503 when private gpt gets ollama service (#2104)
When running private gpt with external ollama API, ollama service
returns 503 on startup because ollama service (traefik) might not be
ready.

- Add healthcheck to ollama service to test for connection to external
ollama
- private-gpt-ollama service depends on ollama being service_healthy

Co-authored-by: Koh Meng Hui <kohmh@duck.com>
2024-10-17 12:44:28 +02:00
Javier Martinez
5851b02378 feat: update llama-index + dependencies (#2092)
* chore: update libraries

* fix: mypy

* chore: more updates

* fix: mypy/black

* chore: fix docker warnings

* fix: mypy

* fix: black
2024-09-26 16:29:52 +02:00
Dmitri Qiu
5fbb402477 fix: Sanitize null bytes before ingestion (#2090)
* Sanitize null bytes before ingestion

* Added comments
2024-09-25 12:00:03 +02:00