ColossalAI/colossalai/shardformer/layer
2025-03-21 10:24:24 +08:00
..
__init__.py [Feature] Support Distributed LogProb for GRPO Training (#6247) 2025-03-18 17:47:55 +08:00
_operation.py [Sharderformer] Support zbv in Sharderformer Policy (#6150) 2025-01-02 10:22:26 +08:00
attn.py [hotfix] fix flash attn window_size err (#6132) 2024-11-14 17:11:35 +08:00
dropout.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
embedding.py [fp8] support hybrid parallel plugin (#5982) 2024-08-12 18:17:05 +08:00
linear.py [CI] Cleanup Dist Optim tests with shared helper funcs (#6125) 2025-02-12 13:42:34 +08:00
loss.py fix logprob, add filtering, temperature annealing, lr descent 2025-03-21 10:24:24 +08:00
normalization.py [Hotfix] hotfix normalization (#6163) 2024-12-23 16:29:48 +08:00
parallel_module.py [shardformer] refactor embedding resize (#5603) 2024-04-18 16:10:18 +08:00
qkv_fused_linear.py [Sharderformer] Support zbv in Sharderformer Policy (#6150) 2025-01-02 10:22:26 +08:00
utils.py [Sharderformer] Support zbv in Sharderformer Policy (#6150) 2025-01-02 10:22:26 +08:00