Wenxuan Tan 48a673dcb0 [Ring Attention] Add more detailed references (#6294) ...

* fix

* fix

2025-08-26 21:51:16 +08:00

..

__init__.py

[Feature] Support Distributed LogProb for GRPO Training (#6247)

2025-08-05 13:59:02 +08:00

_operation.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00

attn.py

[Ring Attention] Add more detailed references (#6294)

2025-08-26 21:51:16 +08:00

dropout.py

…

embedding.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

linear.py

[CI] Cleanup Dist Optim tests with shared helper funcs (#6125)

2025-02-12 13:42:34 +08:00

loss.py

fix logprob, add filtering, temperature annealing, lr descent

2025-08-05 13:59:02 +08:00

normalization.py

[Hotfix] hotfix normalization (#6163)

2024-12-23 16:29:48 +08:00

parallel_module.py

…

qkv_fused_linear.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00

utils.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00