28 Commits

Author	SHA1	Message	Date
YeAnbang	ab55b9f033	fix conversation; support sleep mode	2025-04-23 14:43:54 +08:00
YeAnbang	39a1faac87	tested multi-node training; fix bind_batch bug	2025-04-21 17:33:50 +08:00
YeAnbang	c0c0da2f26	add DAPO support	2025-04-16 17:54:14 +08:00
YeAnbang	cc4faa7300	fix filtering, still buggy	2025-04-16 14:10:43 +08:00
YeAnbang	24c01864df	merge grpo-latest	2025-04-16 10:03:19 +08:00
YeAnbang	6e71e2a3ce	add DAPO support	2025-04-15 18:28:35 +08:00
YeAnbang	9467c10690	[hot-fix] Fix memory leakage bug, support TP+PP (#6258) ... * update help information * update style * fix * minor fix * support PP training * add pp support * remove unused code * address conversation * fix memory leakage support tp+pp * move empty cache * move empty cache --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-04-10 10:52:18 +08:00
YeAnbang	1ea3b72c22	fix memory leakage support tp+pp	2025-04-09 17:11:55 +08:00
YeAnbang	ed43a4be04	[Distributed RLHF] Integration of PP (#6257) ... * update help information * update style * fix * minor fix * support PP training * add pp support * remove unused code * address conversation --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-04-09 13:23:24 +08:00
YeAnbang	a40d82f629	address conversation	2025-04-09 12:53:40 +08:00
YeAnbang	09a3173a49	add pp support	2025-04-04 10:05:16 +08:00
Tong Li	d961a5f725	support PP training	2025-04-01 11:24:09 +08:00
Tong Li	6604654b2f	minor fix	2025-03-31 13:15:18 +08:00
Tong Li	9d6ede98dc	fix	2025-03-31 13:14:41 +08:00
Tong Li	27d0108c9f	update style	2025-03-31 11:44:10 +08:00
Tong Li	729456957a	update help information	2025-03-31 11:35:23 +08:00
YeAnbang	50153005b4	[feat] add microbatch forwarding (#6251) ... * add microbatch forwarding * fix forward microbatch * fix producer OOM * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * change project name * fix temperature annealing * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * address conversation --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2025-03-28 10:24:58 +08:00
YeAnbang	0472f44163	fix logprob, add filtering, temperature annealing, lr descent	2025-03-21 10:24:24 +08:00
YeAnbang	7ee4452f8c	fix vllm	2025-03-19 17:11:10 +08:00
YeAnbang	bc0171d392	fix transformers backend	2025-03-14 18:12:35 +08:00
Tong Li	57b49da5e4	setup update	2025-03-13 16:52:15 +08:00
Tong Li	22cc1558a8	Merge branch 'grpo-latest' of github.com:hpcaitech/ColossalAI into grpo-latest	2025-03-06 16:28:47 +08:00
Tong Li	0590f10fb7	update select algo	2025-03-06 16:27:13 +08:00
pre-commit-ci[bot]	ab5b6d8432	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2025-03-06 06:30:27 +00:00
Tong Li	0f566cc2d4	add algo selection	2025-03-06 14:29:22 +08:00
Tong Li	7f2ceac5c3	update example	2025-03-06 10:54:23 +08:00
Tong Li	070907dd7f	polish	2025-02-28 10:16:42 +08:00
Hongxin Liu	43c9b5fb44	[chat] add distributed impl (#6210)	2025-02-21 15:24:23 +08:00