duanjunwen 455185345e [Feature] Support Distributed LogProb for GRPO Training (#6247) ...

* [fix] fix qwen VocabParallelLMHead1D and gather output

* fix tp bug

* fix consumer

* [feat] Support Distributed LogProb for GRPO Training

* [fix] fix loss func

* [fix] fix log prob plugin

* [fix] fix qwen modeling param

* [fix] rm comments

* [fix] rm hard-code;fix non-dist version

* [fix] fix test file param name and benchmark tp gather output=True/False

* [fix] rm non-dist version in dist log prob

* [fix] fix comments

* [fix] fix dis log prob plugin

* [fix] fix test case

* [fix] fix qwen VocabParallelLMHead1D and gather output

* [fix] fix DistLogProb comments

* [fix] restore tp size

* [fix] fix comments

* [fix] fix comment; fix LogSoftmax usage

---------

Co-authored-by: Tong Li <tong.li35271158@gmail.com>

2025-08-05 13:59:02 +08:00

..

kit

[CI] disable timm_regnetv_040 as aten::_unique2 is not supproted

2025-07-14 07:50:38 +00:00

test_analyzer

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_auto_parallel

[test] Fix/fix testcase (#5770)

2024-06-03 15:26:01 +08:00

test_autochunk

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_booster

[plugin] support get_grad_norm (#6115)

2024-11-05 18:12:47 +08:00

test_checkpoint_io

[shardformer] support pipeline for deepseek v3 and optimize lora save (#6188)

2025-02-14 14:48:54 +08:00

test_cluster

[misc] update torch version (#6206)

2025-02-24 14:35:48 +08:00

test_config

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

test_device

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00

test_fp8

[ci] update ci (#6254)

2025-04-18 16:40:53 +08:00

test_fx

[hotfix] fix testcase in test_fx/test_tracer (#5779)

2024-06-05 11:29:32 +08:00

test_infer

[upgrade]Upgrade transformers (#6320)

2025-05-27 14:29:01 +08:00

test_lazy

[fix] fix_lazy_init for deepseek model in transformers

2025-06-02 11:31:45 +08:00

test_legacy

[FP8] rebase main (#5963)

2024-08-06 16:29:37 +08:00

test_lora

[fp8] Merge feature/fp8_comm to main branch of Colossalai (#6016)

2024-08-22 09:21:34 +08:00

test_moe

[hotfix] moe hybrid parallelism benchmark & follow-up fix (#6048)

2024-09-10 17:30:53 +08:00

test_optimizer

[CI] Cleanup Dist Optim tests with shared helper funcs (#6125)

2025-02-12 13:42:34 +08:00

test_pipeline

[hotfix] fix hybrid checkpointio for sp+dp (#6184)

2025-02-06 17:21:04 +08:00

test_shardformer

[Feature] Support Distributed LogProb for GRPO Training (#6247)

2025-08-05 13:59:02 +08:00

test_smoothquant

[inference] Add smmoothquant for llama (#4904)

2023-10-16 11:28:44 +08:00

test_tensor

[misc] refactor launch API and tensor constructor (#5666)

2024-04-29 10:40:11 +08:00

test_zero

release

2025-05-27 14:38:59 +08:00

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00

conftest.py

[checkpointio] support load-pin overlap (#6177)

2025-01-07 16:16:04 +08:00