duanjunwen 7795d4c50d [Feature] Support Distributed LogProb for GRPO Training (#6247) ... * [fix] fix qwen VocabParallelLMHead1D and gather output * fix tp bug * fix consumer * [feat] Support Distributed LogProb for GRPO Training * [fix] fix loss func * [fix] fix log prob plugin * [fix] fix qwen modeling param * [fix] rm comments * [fix] rm hard-code;fix non-dist version * [fix] fix test file param name and benchmark tp gather output=True/False * [fix] rm non-dist version in dist log prob * [fix] fix comments * [fix] fix dis log prob plugin * [fix] fix test case * [fix] fix qwen VocabParallelLMHead1D and gather output * [fix] fix DistLogProb comments * [fix] restore tp size * [fix] fix comments * [fix] fix comment; fix LogSoftmax usage --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>		2025-03-18 17:47:55 +08:00
..
kit	[release] update version (#6195)	2025-02-20 11:36:18 +08:00
test_analyzer	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_auto_parallel	[test] Fix/fix testcase (#5770)	2024-06-03 15:26:01 +08:00
test_autochunk	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_booster	[plugin] support get_grad_norm (#6115)	2024-11-05 18:12:47 +08:00
test_checkpoint_io	[shardformer] support pipeline for deepseek v3 and optimize lora save (#6188)	2025-02-14 14:48:54 +08:00
test_cluster	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_config	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_device	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_fp8	[fp8] Disable all_gather intranode. Disable Redundant all_gather fp8 (#6059)	2024-09-14 10:40:01 +08:00
test_fx	[hotfix] fix testcase in test_fx/test_tracer (#5779)	2024-06-05 11:29:32 +08:00
test_infer	[release] update version (#6041)	2024-09-10 10:31:09 +08:00
test_lazy	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)	2024-08-22 09:21:34 +08:00
test_legacy	[FP8] rebase main (#5963)	2024-08-06 16:29:37 +08:00
test_lora	[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)	2024-08-22 09:21:34 +08:00
test_moe	[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048)	2024-09-10 17:30:53 +08:00
test_optimizer	[CI] Cleanup Dist Optim tests with shared helper funcs (#6125)	2025-02-12 13:42:34 +08:00
test_pipeline	[hotfix] fix hybrid checkpointio for sp+dp (#6184)	2025-02-06 17:21:04 +08:00
test_shardformer	[Feature] Support Distributed LogProb for GRPO Training (#6247)	2025-03-18 17:47:55 +08:00
test_smoothquant	[inference] Add smmoothquant for llama (#4904)	2023-10-16 11:28:44 +08:00
test_tensor	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_zero	[zero] support extra dp (#6123)	2024-11-12 11:20:46 +08:00
__init__.py	[zero] Update sharded model v2 using sharded param v2 (#323)	2022-03-11 15:50:28 +08:00
conftest.py	[checkpointio] support load-pin overlap (#6177)	2025-01-07 16:16:04 +08:00