Commit Graph

18 Commits

Author SHA1 Message Date
YeAnbang
09a3173a49 add pp support 2025-04-04 10:05:16 +08:00
Tong Li
d961a5f725 support PP training 2025-04-01 11:24:09 +08:00
Tong Li
6604654b2f minor fix 2025-03-31 13:15:18 +08:00
Tong Li
9d6ede98dc fix 2025-03-31 13:14:41 +08:00
Tong Li
27d0108c9f update style 2025-03-31 11:44:10 +08:00
Tong Li
729456957a update help information 2025-03-31 11:35:23 +08:00
YeAnbang
50153005b4
[feat] add microbatch forwarding (#6251)
* add microbatch forwarding

* fix forward microbatch

* fix producer OOM

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* change project name

* fix temperature annealing

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* address conversation

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-03-28 10:24:58 +08:00
YeAnbang
0472f44163 fix logprob, add filtering, temperature annealing, lr descent 2025-03-21 10:24:24 +08:00
YeAnbang
7ee4452f8c fix vllm 2025-03-19 17:11:10 +08:00
YeAnbang
bc0171d392 fix transformers backend 2025-03-14 18:12:35 +08:00
Tong Li
57b49da5e4 setup update 2025-03-13 16:52:15 +08:00
Tong Li
22cc1558a8 Merge branch 'grpo-latest' of github.com:hpcaitech/ColossalAI into grpo-latest 2025-03-06 16:28:47 +08:00
Tong Li
0590f10fb7 update select algo 2025-03-06 16:27:13 +08:00
pre-commit-ci[bot]
ab5b6d8432 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2025-03-06 06:30:27 +00:00
Tong Li
0f566cc2d4 add algo selection 2025-03-06 14:29:22 +08:00
Tong Li
7f2ceac5c3 update example 2025-03-06 10:54:23 +08:00
Tong Li
070907dd7f polish 2025-02-28 10:16:42 +08:00
Hongxin Liu
43c9b5fb44
[chat] add distributed impl (#6210) 2025-02-21 15:24:23 +08:00