flybird11111 02d2328a04 support linear accumulation fusion (#5199) ...

support linear accumulation fusion

support linear accumulation fusion

fix

2023-12-29 18:22:42 +08:00

..

__init__.py

[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926)

2023-11-03 13:32:43 +08:00

_operation.py

support linear accumulation fusion (#5199)

2023-12-29 18:22:42 +08:00

dropout.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

embedding.py

[gemini] gemini support tensor parallelism. (#4942)

2023-11-10 10:15:16 +08:00

linear.py

support linear accumulation fusion (#5199)

2023-12-29 18:22:42 +08:00

loss.py

[shardformer] llama support DistCrossEntropy (#5176)

2023-12-13 01:39:14 +08:00

normalization.py

[shardformer]: support gpt-j, falcon, Mistral and add interleaved pipeline for bert (#5088)

2023-11-28 16:54:42 +08:00

parallel_module.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

qkv_fused_linear.py

[misc] update pre-commit and run all files (#4752)

2023-09-19 14:20:26 +08:00

utils.py

[npu] add npu support for hybrid plugin and llama (#5090)

2023-11-22 19:23:21 +08:00