duanjunwen 7795d4c50d [Feature] Support Distributed LogProb for GRPO Training (#6247) ... * [fix] fix qwen VocabParallelLMHead1D and gather output * fix tp bug * fix consumer * [feat] Support Distributed LogProb for GRPO Training * [fix] fix loss func * [fix] fix log prob plugin * [fix] fix qwen modeling param * [fix] rm comments * [fix] rm hard-code;fix non-dist version * [fix] fix test file param name and benchmark tp gather output=True/False * [fix] rm non-dist version in dist log prob * [fix] fix comments * [fix] fix dis log prob plugin * [fix] fix test case * [fix] fix qwen VocabParallelLMHead1D and gather output * [fix] fix DistLogProb comments * [fix] restore tp size * [fix] fix comments * [fix] fix comment; fix LogSoftmax usage --------- Co-authored-by: Tong Li <tong.li35271158@gmail.com>		2025-03-18 17:47:55 +08:00
..
test_dist_crossentropy.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_dist_log_prob.py	[Feature] Support Distributed LogProb for GRPO Training (#6247)	2025-03-18 17:47:55 +08:00
test_dropout.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_embedding.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_gpt2_qkv_fused_linear_1d.py	[Sharderformer] Support zbv in Sharderformer Policy (#6150)	2025-01-02 10:22:26 +08:00
test_layernorm.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_linear_1d.py	[Zerobubble] merge main. (#6142)	2024-11-19 19:00:36 +08:00
test_qkv_fused_linear_1d.py	[Sharderformer] Support zbv in Sharderformer Policy (#6150)	2025-01-02 10:22:26 +08:00
test_ring_attn.py	fix	2024-10-15 13:26:44 +08:00
test_sequence_parallel.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
test_vocab_parallel_embedding_1d.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00