Tong Li
|
923b23d5fe
|
move out evaluation func
|
2025-06-10 05:09:22 +00:00 |
|
YeAnbang
|
c308b42f38
|
Merge pull request #6341 from hpcaitech/grpo-code
[feat] Support Code Generation RFT, Move Reward Calculation to Producer
|
2025-06-09 17:02:13 +08:00 |
|
pre-commit-ci[bot]
|
9ca920c1af
|
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
|
2025-06-09 01:48:20 +00:00 |
|
YeAnbang
|
d0e12c508a
|
remove debug code
|
2025-06-09 09:42:58 +08:00 |
|
YeAnbang
|
3bed6ae9ee
|
fix bug, tested
|
2025-06-09 09:37:28 +08:00 |
|
YeAnbang
|
dc3033e68a
|
support code generation tasks
|
2025-06-05 18:05:22 +08:00 |
|
YeAnbang
|
ceb7065d6d
|
Merge pull request #6312 from hpcaitech/grpo-latest-dev
[feat] Move prompt-level-filtering to buffer side
|
2025-06-05 15:51:38 +08:00 |
|
YeAnbang
|
96faf54542
|
fix typ and parameter description
|
2025-06-05 15:41:14 +08:00 |
|
pre-commit-ci[bot]
|
0d008110e7
|
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
|
2025-05-29 10:16:56 +00:00 |
|
YeAnbang
|
7b921acc8a
|
merge grpo-latest
|
2025-05-29 18:14:43 +08:00 |
|
YeAnbang
|
ee939d9aa5
|
address conversation
|
2025-05-29 10:25:59 +08:00 |
|
Tong Li
|
c8b368c294
|
add overlength sample count (#6332)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-28 19:18:09 +08:00 |
|
YeAnbang
|
58f8c9bb43
|
Merge branch 'grpo-latest' of https://github.com/hpcaitech/ColossalAI into grpo-latest-dev
|
2025-05-28 17:34:52 +08:00 |
|
YeAnbang
|
4c3656870a
|
address conversation
|
2025-05-28 17:34:11 +08:00 |
|
Tong Li
|
de2ad3b206
|
fix default eval setting (#6321)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-22 11:52:41 +08:00 |
|
YeAnbang
|
78a06f5ce3
|
fix missing tags parameter
|
2025-05-21 10:51:32 +08:00 |
|
YeAnbang
|
88e3b09c79
|
merge grpo-latest
|
2025-05-20 18:16:43 +08:00 |
|
YeAnbang
|
37663386bc
|
fix metric calculation
|
2025-05-20 18:14:05 +08:00 |
|
Tong Li
|
32afa7bf29
|
fix empty tensor (#6319)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-20 17:41:44 +08:00 |
|
YeAnbang
|
bcf2459db5
|
Merge pull request #6314 from hpcaitech/grpo-reward-dev
[feat] upgrade reward functions
|
2025-05-20 10:06:00 +08:00 |
|
YeAnbang
|
f8bd2db33f
|
add uuid to rollout log
|
2025-05-20 09:45:56 +08:00 |
|
YeAnbang
|
116621d004
|
merge reward and eval
|
2025-05-19 11:53:47 +08:00 |
|
YeAnbang
|
107470a360
|
fix logging rollouts
|
2025-05-17 21:12:58 +08:00 |
|
YeAnbang
|
03b41d6fb5
|
upgrade reward functions
|
2025-05-16 18:04:38 +08:00 |
|
YeAnbang
|
3c42c0ce82
|
Merge pull request #6309 from hpcaitech/grpo-eval-dev
[feat] Support evaluation during training
|
2025-05-16 16:11:23 +08:00 |
|
YeAnbang
|
021914c565
|
support logging rollouts to wandb
|
2025-05-16 15:56:03 +08:00 |
|
YeAnbang
|
203dfb1536
|
address conversation
|
2025-05-16 14:15:35 +08:00 |
|
YeAnbang
|
11a5854b50
|
remove redundant code and fix bugs
|
2025-05-16 14:08:23 +08:00 |
|
Tong Li
|
ab95624915
|
handle empty index (#6311)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-16 10:00:10 +08:00 |
|
YeAnbang
|
6abffb9100
|
fix evaluation
|
2025-05-16 09:42:35 +08:00 |
|
Tong Li
|
1644adf684
|
handle empty index
|
2025-05-15 20:32:05 +08:00 |
|
YeAnbang
|
a528921944
|
move prompt-level-filtering to buffer side
|
2025-05-15 18:30:32 +08:00 |
|
YeAnbang
|
55eee129d2
|
move prompt-level-filtering to buffer side
|
2025-05-15 18:16:50 +08:00 |
|
YeAnbang
|
957e3a521a
|
disable wandb tb syncing
|
2025-05-15 16:52:31 +08:00 |
|
YeAnbang
|
4ec73298b2
|
use consumer global step
|
2025-05-15 14:15:40 +08:00 |
|
YeAnbang
|
094f119b3a
|
merge
|
2025-05-14 18:13:47 +08:00 |
|
YeAnbang
|
50070c1e84
|
move logging to producer
|
2025-05-14 18:10:57 +08:00 |
|
Tong Li
|
aca547623f
|
[feat] Support prompt level dynamic (#6300)
* adjust to dynamic prompt bs
* remove debug
* update pad seq (#6303)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
* adjust to dynamic prompt bs
* remove debug
* fix dp issue
* fix
* fix default settings
---------
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-14 16:40:35 +08:00 |
|
YeAnbang
|
47a7dc7142
|
Support evaluation during training
|
2025-05-14 11:03:11 +08:00 |
|
Tong Li
|
b920af427b
|
update pad seq (#6303)
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-05-13 16:51:27 +08:00 |
|
YeAnbang
|
eb6b5dd62e
|
[fix] revert reward update and evaluation (#6295)
* Revert "rewrite reward fn"
This reverts commit d06042b434.
* Revert "upgrade reward math verification"
This reverts commit a6085ff676.
* Revert "fix bug"
This reverts commit 01640ebd65.
* Revert "reuse comm-group"
This reverts commit bd61918dcf.
* Revert "Support evaluation during training"
This reverts commit 57a88395fe.
|
2025-05-07 10:56:47 +08:00 |
|
YeAnbang
|
17928ad84f
|
Merge pull request #6292 from hpcaitech/grpo-latest-dev-reward-update
[feat] Update reward verification
|
2025-05-03 10:00:32 +08:00 |
|
YeAnbang
|
d06042b434
|
rewrite reward fn
|
2025-05-01 11:28:05 +08:00 |
|
YeAnbang
|
a6085ff676
|
upgrade reward math verification
|
2025-04-30 22:59:54 +08:00 |
|
YeAnbang
|
01640ebd65
|
fix bug
|
2025-04-30 22:53:12 +08:00 |
|
YeAnbang
|
bd61918dcf
|
reuse comm-group
|
2025-04-30 21:36:11 +08:00 |
|
YeAnbang
|
57a88395fe
|
Support evaluation during training
|
2025-04-30 18:31:49 +08:00 |
|
Tong Li
|
5fd4bcb9d8
|
[feat] Sync shard model (#6289)
* [feat] support hybrid parallel model sync
* update consumer and producer
* update files
* update producer
* remove print
* update
---------
Co-authored-by: duanjunwen <935724073@qq.com>
Co-authored-by: YeAnbang <44796419+YeAnbang@users.noreply.github.com>
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
|
2025-04-30 14:47:01 +08:00 |
|
YeAnbang
|
14f237ce7e
|
[feat] Support boxed math reward (#6284)
* fix pp+tp, fix dataloader
* fixed plugin micro-batch size
* support boxed reward
* add boxed reward
* fix pp state dict incomplete issue
* Revert "fix pp state dict incomplete issue"
This reverts commit 6c1b3b694f.
|
2025-04-29 16:46:47 +08:00 |
|
YeAnbang
|
2ca1e3c630
|
fix pp+tp, fix dataloader (#6280)
|
2025-04-28 17:10:00 +08:00 |
|