Commit Graph

187 Commits

Author SHA1 Message Date
Fangyin Cheng
946c4aa8f9 chore(core): Remove python-dotenv 2025-05-23 11:21:12 +08:00
alanchen
3dd53e8ffb feat(web): Dashboard supports Pie Chart visualization (#2709)
# Description

Implement Pie Chart visualization support in dashboard components.

This PR adds pie chart visualization capability to the dashboard,
allowing users to:
- Render pie charts in the chat_dashboard mode
- Preview pie charts in the chat_dashboard editor mode

## Implementation Details

- Added new file: `web/components/chart/pie-chart.tsx` that implements
pie chart rendering logic using G2
- Modified `web/components/chart/index.tsx` to integrate the pie chart
component into the dashboard chart rendering flow
- Added animation effects, hover interactions, and improved legend
display
- Fixed interaction bugs to ensure smooth visualization

# How Has This Been Tested?

Testing procedure included:
1. Creating datasets with category-based data suitable for pie charts
2. Verifying pie chart visualization in chat_dashboard mode
3. Confirming preview functionality works correctly in the editor mode
4. Testing interactions: hover effects, animations, and legend display

All tests confirm the feature works as expected with proper
visualization of categorical data proportions.

# Snapshots:

![image](https://github.com/user-attachments/assets/575e3306-62e8-4c91-ae7f-928770534b95)

![image](https://github.com/user-attachments/assets/efc6bdec-5e1f-4172-9b08-10fb8e439c68)



# Checklist:

- [x] My code follows the style guidelines of this project
- [x] I have already rebased the commits and make the commit message
conform to the project standard.
- [x] I have performed a self-review of my own code
- [x] I have commented my code, particularly in hard-to-understand areas
- [x] I have made corresponding changes to the documentation
- [x] Any dependent changes have been merged and published in downstream
modules

Fixes #2708
2025-05-22 17:38:15 +08:00
geebytes
cbc28ea335 Bugfix(RAG):handle exceptions in aload_document_with_limit results (#2712) 2025-05-22 17:00:03 +08:00
Fangyin Cheng
f79f81ccc3 feat(flow): Add Chat Data template (#2716) 2025-05-22 15:52:24 +08:00
WangzJi
3a423aa14e chore(static): Build web static files for pie chart improvements #2708 2025-05-21 00:23:02 +08:00
alanchen
7e7581e891 chore: upgrade pandas version (#2705) 2025-05-20 19:24:27 +08:00
z.h.z
38174c03c8 Merge remote-tracking branch 'upstream/main' into fix-修复提示词模板错别字 2025-05-15 16:42:11 +08:00
Eric Wong
d2429eeff4 fix: resolve KeyError: 'question' in chat_dashboard prompt template (#2695)
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
2025-05-15 16:41:38 +08:00
z.h.z
0b6d4cb545 fix: 修改提示词模板错别字“种”->“中” 2025-05-15 16:30:05 +08:00
Emmanuel Ferdman
d300a4d412 Resolve warnings of logger library (#2681)
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
2025-05-15 15:55:16 +08:00
alanchen
6a82d9122b feat(web): chat message auto scroll (#2682) 2025-05-15 15:53:51 +08:00
Fangyin Cheng
6937b970e5 feat(model): Support llama.cpp for GLM4-z1 (#2690) 2025-05-14 10:49:53 +08:00
alanchen
d83704d233 fix(VectorStore): fix task concurrency and batch processing issue (#2671)
- Refactor task execution to improve concurrency control
- Implement batch processing for vector deletion in Chroma store

# Description

1 ,When chunk a knowledge base file, if there are too many chunks ,
using asyncio.gather(*tasks) will cause the CPU to freeze
2 , When using the Chroma vector database, if the one-time deletion of
embedding documents ids exceeds 5461, it will fail

![0e64098babaa448ec139933fecf5776](https://github.com/user-attachments/assets/f9fa81c1-2914-44e6-8d31-a16d7717c6b3)


# How Has This Been Tested?

# Snapshots:

![ff0ca0d2b35be11dd19aa1983a196ba](https://github.com/user-attachments/assets/4db4202e-5c71-4c97-b075-465ea5419657)

![c8821b068b0c8b73757700d2ecaa23a](https://github.com/user-attachments/assets/b6bc28d0-9406-4b6b-92cf-6a9765288fd2)

Include snapshots for easier review.

# Checklist:

- [x] My code follows the style guidelines of this project
- [x] I have already rebased the commits and make the commit message
conform to the project standard.
- [x] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] Any dependent changes have been merged and published in downstream
modules
2025-05-12 16:25:06 +08:00
Fangyin Cheng
4f39850ac1 feat(model): Add patch for Qwen3 moe (#2676) 2025-05-12 14:44:25 +08:00
Tam
3a65e1b65f fix(VectorStore) fix MilvusStore to use serialize function for metadata json encoding (#2672)
Co-authored-by: tam <tanwe@fulan.com.cn>
2025-05-10 13:10:26 +08:00
Aries-ckt
421004a1d8 feat(RAG):add tree retriever based on document directory level (#2669) 2025-05-10 13:02:26 +08:00
tam
fc6c9071ff format code 2025-05-06 23:47:06 +08:00
tam
4eb06299e8 fix(VectorStore): fix task concurrency and batch processing
- Refactor task execution to improve concurrency control
- Implement batch processing for vector deletion in Chroma store
2025-05-06 23:23:40 +08:00
Fangyin Cheng
3a00aca113 feat(agent): Optimize agent memory (#2665) 2025-04-30 09:49:17 +08:00
Tam
b901cbc9a6 feat(agent): The SQL execution result of the DataScientist can be passed to the next agent (#2654)
Co-authored-by: tam <tanwe@fulan.com.cn>
2025-04-29 19:28:09 +08:00
Fangyin Cheng
2abd68d6c0 feat(model): Support Qwen3 models (#2664) 2025-04-29 09:55:28 +08:00
Gecko Security
bcb43266cf [BUG] SQL Injection through CVE Bypass in DB-GPT 0.7.0 (CVE-2024-10835 & CVE-2024-10901) (#2650)
Co-authored-by: nkoorty <amalyshau2002@gmail.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
2025-04-28 13:54:41 +08:00
Gecko Security
b16c6793ec [BUG] RCE Vulnerability in DB-GPT Plugin Upload System (#2649)
Co-authored-by: nkoorty <amalyshau2002@gmail.com>
2025-04-28 13:53:42 +08:00
paxionfruit
445076b433 feat: add model provider InfiniAI (#2653)
Co-authored-by: yaozhuyu <yaozhuyu@infini-ai.com>
2025-04-27 16:22:31 +08:00
luowenwu
1b77ed6319 feat(datasource):add oracle datasource (#2629)
Co-authored-by: luobin <luobin@wondersgroup.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
2025-04-27 16:21:11 +08:00
seoibiubiu
430235bd1b Fix Clickhouse SQL syntax error for RdbmsSummary (#2651) 2025-04-24 22:44:46 +08:00
Cooper
0b3ac35ede fix(model): fix remote reranker api & fix long_term memory (#2648)
Co-authored-by: dong <dongzhancai@iie2.com>
2025-04-24 11:17:20 +08:00
Fangyin Cheng
a059ef1412 fix(agent): Fix long-term memory error 2025-04-23 11:09:59 +08:00
Fangyin Cheng
3d7d52250f feat(model): Proxy multimodal supports (#2641) 2025-04-21 19:36:29 +08:00
tam
32b1fd4c1e feat(knowledge): add reranking functionality for simple_assistant_agent and summary_assis_agent
- Implement reranking of retrieved chunks when needed
- Improve relevance of search results by ranking chunks based on query
2025-04-21 09:58:01 +08:00
tam
b0ef14c111 fmt(knowledge): reformat retriever resource code
- Adjust import order for better organization
- Improve code readability with proper line breaks and indentation
- Remove unnecessary empty lines
2025-04-19 17:48:54 +08:00
tam
fbfc972908 feat(knowledge): integrate reranking functionality into RetrieverResource
- Add reranking support to improve the quality of retrieved chunks
- Implement RerankEmbeddingFactory and RerankEmbeddingsRanker
- Update RetrieverResource to use reranking when configured
- Modify retrieve method to apply reranking if needed
2025-04-19 17:38:09 +08:00
tam
cc287702bc fix(reranker)In the recall test scenario, the reranking logic is updated based on the application configuration
The logic for determining whether to use reranking and setting the `top_k` value now depends on the `app_config` instead of directly using `CFG.RERANK_MODEL` and `CFG.RERANK_TOP_K`. This change ensures that the application's specific configuration settings are respected.
2025-04-19 15:20:10 +08:00
dobet
129509fcd2 fix connect mssql embedding error (#2589) 2025-04-17 12:44:51 +08:00
magic.chen
8d66d0271f fix:storage add collection bug (#2615)
Close #2595 
# Description
fix hybrid memory milvus create collection bug 

# How Has This Been Tested?

switch milvus for hybrid storage type.

# Snapshots:

Include snapshots for easier review.

# Checklist:

- [ ] My code follows the style guidelines of this project
- [ ] I have already rebased the commits and make the commit message
conform to the project standard.
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] Any dependent changes have been merged and published in downstream
modules
2025-04-15 22:48:26 +08:00
Fangyin Cheng
17b7e5ba0c feat(model): Support GLM-4-0414 (#2630) 2025-04-15 22:48:18 +08:00
Fangyin Cheng
5e7f3568d3 feat(model): Multimodal supports (#2627) 2025-04-15 16:29:02 +08:00
aries_ckt
ac72bb0927 Merge remote-tracking branch 'main-com/main' into fix_issue2590 2025-04-15 10:06:36 +08:00
aries_ckt
2991c7e437 fix:memory create collection bug 2025-04-14 21:29:41 +08:00
aries_ckt
4c6386ad3f fix:add create collection method for other vector db. 2025-04-13 12:24:16 +08:00
aries_ckt
2fad7485fc chore:fmt 2025-04-12 14:34:19 +08:00
aries_ckt
5d67f166d9 fix:storage add collection 2025-04-12 14:18:12 +08:00
Fangyin Cheng
c04e3c7cb0 fix(storage): Fix load big documents error 2025-04-11 20:46:48 +08:00
ethan
12170e2504 feat(mode) : Adding the siliconflow embeding proxy (#2603)
Co-authored-by: 9527 <9527@163.com>
Co-authored-by: Fangyin Cheng <staneyffer@gmail.com>
2025-04-11 16:41:51 +08:00
ethan
61565f7369 fix: the issue is the app_code can't be stored in the chat_history… (#2606)
Co-authored-by: 9527 <9527@163.com>
2025-04-11 16:41:04 +08:00
Fangyin Cheng
5ddd9e5bf8 fix(model): Fix apiserver error (#2605) 2025-04-10 10:23:49 +08:00
Tam
babc484261 Fix postgresql (#2601)
Co-authored-by: tam <tanwe@fulan.com.cn>
2025-04-10 09:40:45 +08:00
geebytes
90e22ac136 fix: Bugfix/elasticsearch store read config dict (#2577) 2025-04-10 07:36:43 +08:00
Fangyin Cheng
e9ce534ca1 feat(agent): Support SSL/TLS for MCP (#2591) 2025-04-08 08:47:41 +08:00
Cooper
0fd578cf87 fix(agents): fix ReActAgent (#2588) 2025-04-07 13:04:55 +08:00