xysheng-colossal
f9abaa8784
[feat] Update requriments and set return logits False
2025-06-16 17:42:28 +08:00
xysheng-colossal
10e52012e4
[merge] Move prompt-level-filtering to buffer side
2025-06-11 15:14:53 +08:00
YeAnbang
96faf54542
fix typ and parameter description
2025-06-05 15:41:14 +08:00
duanjunwen
84f523a080
[Hotfix] fix requirsments ( #6338 )
...
* [fix] fix colossalai ascend requirments
* [fix] fix colossalai chat requirements
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [fix] fix requirments
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-06-04 09:51:31 +08:00
pre-commit-ci[bot]
0d008110e7
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-05-29 10:16:56 +00:00
YeAnbang
7b921acc8a
merge grpo-latest
2025-05-29 18:14:43 +08:00
YeAnbang
ee939d9aa5
address conversation
2025-05-29 10:25:59 +08:00
Tong Li
c8b368c294
add overlength sample count ( #6332 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-28 19:18:09 +08:00
YeAnbang
58f8c9bb43
Merge branch 'grpo-latest' of https://github.com/hpcaitech/ColossalAI into grpo-latest-dev
2025-05-28 17:34:52 +08:00
YeAnbang
4c3656870a
address conversation
2025-05-28 17:34:11 +08:00
Tong Li
180cea709b
update to conform to json format
2025-05-28 13:13:21 +08:00
Tong Li
f4e3063dc3
[Ascend] Update README ( #6331 )
...
* update readme
* [fix] add vllm & vllm-ascend installation
---------
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
Co-authored-by: duanjunwen <935724073@qq.com>
2025-05-28 11:35:35 +08:00
duanjunwen
e1ca2d22ae
[ColossalRL] Support ColossalRL on Ascend ( #6324 )
...
* [fix] support npu
* [feat] multinode 14B
* [feat] enlarge seqlen
* [fix]
* [fix] ready to updated
* [fix] ready to merge grpo-latest
* [fix] rm comments
* [feat] support msprof-analyze, add analsys result
* [feat] support ColossalaiRL on Ascend
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [feat] rm comments in qwen modeling
* [Doc] Drafted README.md
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [feat] fix ascend readme format
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [fix] fix readme
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [fix] fix readme
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [fix] fix Readme, rm irrelevant testcase
* [fix] fix some adapt modification
* [fix] rm comments in modeling qwen
* [fix] rm comm, test and debug print
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: YeAnbang <44796419+YeAnbang@users.noreply.github.com>
2025-05-28 10:43:13 +08:00
Tong Li
de2ad3b206
fix default eval setting ( #6321 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-22 11:52:41 +08:00
YeAnbang
78a06f5ce3
fix missing tags parameter
2025-05-21 10:51:32 +08:00
YeAnbang
88e3b09c79
merge grpo-latest
2025-05-20 18:16:43 +08:00
YeAnbang
37663386bc
fix metric calculation
2025-05-20 18:14:05 +08:00
Tong Li
32afa7bf29
fix empty tensor ( #6319 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-20 17:41:44 +08:00
YeAnbang
bcf2459db5
Merge pull request #6314 from hpcaitech/grpo-reward-dev
...
[feat] upgrade reward functions
2025-05-20 10:06:00 +08:00
YeAnbang
f8bd2db33f
add uuid to rollout log
2025-05-20 09:45:56 +08:00
YeAnbang
116621d004
merge reward and eval
2025-05-19 11:53:47 +08:00
YeAnbang
107470a360
fix logging rollouts
2025-05-17 21:12:58 +08:00
YeAnbang
03b41d6fb5
upgrade reward functions
2025-05-16 18:04:38 +08:00
YeAnbang
3c42c0ce82
Merge pull request #6309 from hpcaitech/grpo-eval-dev
...
[feat] Support evaluation during training
2025-05-16 16:11:23 +08:00
YeAnbang
021914c565
support logging rollouts to wandb
2025-05-16 15:56:03 +08:00
YeAnbang
203dfb1536
address conversation
2025-05-16 14:15:35 +08:00
YeAnbang
11a5854b50
remove redundant code and fix bugs
2025-05-16 14:08:23 +08:00
Tong Li
ab95624915
handle empty index ( #6311 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-16 10:00:10 +08:00
YeAnbang
6abffb9100
fix evaluation
2025-05-16 09:42:35 +08:00
Tong Li
1644adf684
handle empty index
2025-05-15 20:32:05 +08:00
YeAnbang
a528921944
move prompt-level-filtering to buffer side
2025-05-15 18:30:32 +08:00
YeAnbang
55eee129d2
move prompt-level-filtering to buffer side
2025-05-15 18:16:50 +08:00
YeAnbang
957e3a521a
disable wandb tb syncing
2025-05-15 16:52:31 +08:00
YeAnbang
4ec73298b2
use consumer global step
2025-05-15 14:15:40 +08:00
YeAnbang
094f119b3a
merge
2025-05-14 18:13:47 +08:00
YeAnbang
50070c1e84
move logging to producer
2025-05-14 18:10:57 +08:00
Tong Li
aca547623f
[feat] Support prompt level dynamic ( #6300 )
...
* adjust to dynamic prompt bs
* remove debug
* update pad seq (#6303 )
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
* adjust to dynamic prompt bs
* remove debug
* fix dp issue
* fix
* fix default settings
---------
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-14 16:40:35 +08:00
YeAnbang
47a7dc7142
Support evaluation during training
2025-05-14 11:03:11 +08:00
Tong Li
b920af427b
update pad seq ( #6303 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-05-13 16:51:27 +08:00
YeAnbang
eb6b5dd62e
[fix] revert reward update and evaluation ( #6295 )
...
* Revert "rewrite reward fn"
This reverts commit d06042b434a6085ff67601640ebd65bd61918dcf57a88395fe
2025-05-07 10:56:47 +08:00
YeAnbang
17928ad84f
Merge pull request #6292 from hpcaitech/grpo-latest-dev-reward-update
...
[feat] Update reward verification
2025-05-03 10:00:32 +08:00
YeAnbang
d06042b434
rewrite reward fn
2025-05-01 11:28:05 +08:00
YeAnbang
a6085ff676
upgrade reward math verification
2025-04-30 22:59:54 +08:00
YeAnbang
01640ebd65
fix bug
2025-04-30 22:53:12 +08:00
YeAnbang
bd61918dcf
reuse comm-group
2025-04-30 21:36:11 +08:00
YeAnbang
57a88395fe
Support evaluation during training
2025-04-30 18:31:49 +08:00
Tong Li
5fd4bcb9d8
[feat] Sync shard model ( #6289 )
...
* [feat] support hybrid parallel model sync
* update consumer and producer
* update files
* update producer
* remove print
* update
---------
Co-authored-by: duanjunwen <935724073@qq.com>
Co-authored-by: YeAnbang <44796419+YeAnbang@users.noreply.github.com>
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-04-30 14:47:01 +08:00
YeAnbang
14f237ce7e
[feat] Support boxed math reward ( #6284 )
...
* fix pp+tp, fix dataloader
* fixed plugin micro-batch size
* support boxed reward
* add boxed reward
* fix pp state dict incomplete issue
* Revert "fix pp state dict incomplete issue"
This reverts commit 6c1b3b694f
2025-04-29 16:46:47 +08:00
YeAnbang
2ca1e3c630
fix pp+tp, fix dataloader ( #6280 )
2025-04-28 17:10:00 +08:00
Tong Li
28795f560c
fix save issue ( #6279 )
...
Co-authored-by: Tong Li <tong.li35271158@gmail.com>
2025-04-27 17:54:06 +08:00
