435 Commits

Author	SHA1	Message	Date
Tong Li	973dea21c7	remove assert	2025-06-27 14:16:23 +08:00
Tong Li	90c3b12474	update assert	2025-06-27 13:14:35 +08:00
Tong Li	a0f8680e85	fix update	2025-06-27 09:52:50 +08:00
Tong Li	58cb4fb4f7	add profiling	2025-06-26 17:49:53 +08:00
Tong Li	71ef6b32c6	fix loop issue	2025-06-26 15:08:27 +08:00
Tong Li	8abf186ce2	fix behind	2025-06-26 10:27:00 +08:00
YeAnbang	db8baeeaf2	fix visualization	2025-06-20 15:52:09 +08:00
YeAnbang	c2561f826a	fix bugs	2025-06-20 15:44:13 +08:00
YeAnbang	ff6696a9bb	support n_behind, add profiling	2025-06-20 03:14:00 +00:00
YeAnbang	e3d56cbd86	implement memory efficient logprob	2025-06-18 10:24:48 +00:00
YeAnbang	30a6859f77	optimize pp log_softmax OOM	2025-06-13 18:21:54 +08:00
YeAnbang	51b7abe9dd	fix num_update_per_episode	2025-06-12 15:06:01 +08:00
YeAnbang	ac069357a9	Merge pull request #6316 from hpcaitech/grpo-support-multi-machine ... [feat] Manually schedule resources and support auto master address assigning	2025-06-12 11:23:06 +08:00
YeAnbang	2f02a28777	Update README.md	2025-06-12 11:21:31 +08:00
Tong Li	8992def757	fix pp memory issue (#6344) ... Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-06-11 17:54:18 +08:00
YeAnbang	1330b5753b	add ray timeout handling instruction	2025-06-10 18:21:42 +08:00
YeAnbang	dc29c74632	update readme	2025-06-10 17:17:41 +08:00
YeAnbang	25599246c5	modify readme	2025-06-10 17:00:35 +08:00
YeAnbang	21d517d0fa	Manually schedule resources and support auto master address assigning	2025-06-10 15:00:48 +08:00
Tong Li	bb6f5d98fc	move out evaluation func (#6343) ... Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-06-10 13:53:19 +08:00
pre-commit-ci[bot]	9ca920c1af	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2025-06-09 01:48:20 +00:00
YeAnbang	d0e12c508a	remove debug code	2025-06-09 09:42:58 +08:00
YeAnbang	3bed6ae9ee	fix bug, tested	2025-06-09 09:37:28 +08:00
YeAnbang	dc3033e68a	support code generation tasks	2025-06-05 18:05:22 +08:00
YeAnbang	96faf54542	fix typ and parameter description	2025-06-05 15:41:14 +08:00
pre-commit-ci[bot]	0d008110e7	[pre-commit.ci] auto fixes from pre-commit.com hooks ... for more information, see https://pre-commit.ci	2025-05-29 10:16:56 +00:00
YeAnbang	7b921acc8a	merge grpo-latest	2025-05-29 18:14:43 +08:00
YeAnbang	ee939d9aa5	address conversation	2025-05-29 10:25:59 +08:00
Tong Li	c8b368c294	add overlength sample count (#6332) ... Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-05-28 19:18:09 +08:00
YeAnbang	58f8c9bb43	Merge branch 'grpo-latest' of https://github.com/hpcaitech/ColossalAI into grpo-latest-dev	2025-05-28 17:34:52 +08:00
YeAnbang	4c3656870a	address conversation	2025-05-28 17:34:11 +08:00
Tong Li	de2ad3b206	fix default eval setting (#6321) ... Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-05-22 11:52:41 +08:00
YeAnbang	78a06f5ce3	fix missing tags parameter	2025-05-21 10:51:32 +08:00
YeAnbang	88e3b09c79	merge grpo-latest	2025-05-20 18:16:43 +08:00
YeAnbang	37663386bc	fix metric calculation	2025-05-20 18:14:05 +08:00
Tong Li	32afa7bf29	fix empty tensor (#6319) ... Co-authored-by: Tong Li <tong.li35271158@gmail.com>	2025-05-20 17:41:44 +08:00
YeAnbang	f8bd2db33f	add uuid to rollout log	2025-05-20 09:45:56 +08:00
YeAnbang	116621d004	merge reward and eval	2025-05-19 11:53:47 +08:00
YeAnbang	107470a360	fix logging rollouts	2025-05-17 21:12:58 +08:00
YeAnbang	03b41d6fb5	upgrade reward functions	2025-05-16 18:04:38 +08:00
YeAnbang	021914c565	support logging rollouts to wandb	2025-05-16 15:56:03 +08:00
YeAnbang	203dfb1536	address conversation	2025-05-16 14:15:35 +08:00
YeAnbang	11a5854b50	remove redundant code and fix bugs	2025-05-16 14:08:23 +08:00
YeAnbang	6abffb9100	fix evaluation	2025-05-16 09:42:35 +08:00
Tong Li	1644adf684	handle empty index	2025-05-15 20:32:05 +08:00
YeAnbang	a528921944	move prompt-level-filtering to buffer side	2025-05-15 18:30:32 +08:00
YeAnbang	55eee129d2	move prompt-level-filtering to buffer side	2025-05-15 18:16:50 +08:00
YeAnbang	957e3a521a	disable wandb tb syncing	2025-05-15 16:52:31 +08:00
YeAnbang	4ec73298b2	use consumer global step	2025-05-15 14:15:40 +08:00
YeAnbang	094f119b3a	merge	2025-05-14 18:13:47 +08:00