YeAnbang
09a3173a49
add pp support
2025-04-04 10:05:16 +08:00
Tong Li
d961a5f725
support PP training
2025-04-01 11:24:09 +08:00
Tong Li
6604654b2f
minor fix
2025-03-31 13:15:18 +08:00
Tong Li
9d6ede98dc
fix
2025-03-31 13:14:41 +08:00
Tong Li
27d0108c9f
update style
2025-03-31 11:44:10 +08:00
Tong Li
729456957a
update help information
2025-03-31 11:35:23 +08:00
YeAnbang
50153005b4
[feat] add microbatch forwarding ( #6251 )
...
* add microbatch forwarding
* fix forward microbatch
* fix producer OOM
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* change project name
* fix temperature annealing
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* address conversation
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-03-28 10:24:58 +08:00
YeAnbang
0472f44163
fix logprob, add filtering, temperature annealing, lr descent
2025-03-21 10:24:24 +08:00
YeAnbang
7ee4452f8c
fix vllm
2025-03-19 17:11:10 +08:00
YeAnbang
bc0171d392
fix transformers backend
2025-03-14 18:12:35 +08:00
Tong Li
57b49da5e4
setup update
2025-03-13 16:52:15 +08:00
Tong Li
22cc1558a8
Merge branch 'grpo-latest' of github.com:hpcaitech/ColossalAI into grpo-latest
2025-03-06 16:28:47 +08:00
Tong Li
0590f10fb7
update select algo
2025-03-06 16:27:13 +08:00
pre-commit-ci[bot]
ab5b6d8432
[pre-commit.ci] auto fixes from pre-commit.com hooks
...
for more information, see https://pre-commit.ci
2025-03-06 06:30:27 +00:00
Tong Li
0f566cc2d4
add algo selection
2025-03-06 14:29:22 +08:00
Tong Li
7f2ceac5c3
update example
2025-03-06 10:54:23 +08:00
Tong Li
070907dd7f
polish
2025-02-28 10:16:42 +08:00
Hongxin Liu
43c9b5fb44
[chat] add distributed impl ( #6210 )
2025-02-21 15:24:23 +08:00