Wenxuan Tan ec73f1b5e2 [CI] Cleanup Dist Optim tests with shared helper funcs (#6125) ...

* Refractor and cleanup using common helper funcs. Tests passed

* Update comments

* Fix relative import

* Fix param fetching bug

2025-02-12 13:42:34 +08:00

..

__init__.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00

_operation.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00

attn.py

[hotfix] fix flash attn window_size err (#6132)

2024-11-14 17:11:35 +08:00

dropout.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

embedding.py

[fp8] support hybrid parallel plugin (#5982)

2024-08-12 18:17:05 +08:00

linear.py

[CI] Cleanup Dist Optim tests with shared helper funcs (#6125)

2025-02-12 13:42:34 +08:00

loss.py

[Feature] Split cross-entropy computation in SP (#5959)

2024-09-10 12:06:50 +08:00

normalization.py

[Hotfix] hotfix normalization (#6163)

2024-12-23 16:29:48 +08:00

parallel_module.py

[shardformer] refactor embedding resize (#5603)

2024-04-18 16:10:18 +08:00

qkv_fused_linear.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00

utils.py

[Sharderformer] Support zbv in Sharderformer Policy (#6150)

2025-01-02 10:22:26 +08:00