Guangyao Zhang 53cb9606bd [Feature] llama shardformer fp8 support (#5938) ...

* add llama shardformer fp8

* Llama Shardformer Parity

* fix typo

* fix all reduce

* fix pytest failure

* fix reduce op and move function to fp8.py

* fix typo

2024-08-05 10:05:47 +08:00

..

test_fp8_all_to_all_single.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00

test_fp8_all_to_all.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00

test_fp8_allgather_flat.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00

test_fp8_allreduce.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00

test_fp8_gather.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00

test_fp8_reduce_scatter.py

[Feature] llama shardformer fp8 support (#5938)

2024-08-05 10:05:47 +08:00