2 Commits

Author	SHA1	Message	Date
flybird11111	597b206001	[fp8] support asynchronous FP8 communication (#5997) ... * fix * fix * fix * support async all2all * support async op for all gather * fix * fix * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>	2024-08-14 14:08:19 +08:00
Guangyao Zhang	53cb9606bd	[Feature] llama shardformer fp8 support (#5938) ... * add llama shardformer fp8 * Llama Shardformer Parity * fix typo * fix all reduce * fix pytest failure * fix reduce op and move function to fp8.py * fix typo	2024-08-05 10:05:47 +08:00