github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-20 04:32:47 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,780 Commits 55 Branches 51 Tags 235 MiB
ckpt_api
Commit Graph

2 Commits

Author SHA1 Message Date
flybird11111
597b206001
[fp8] support asynchronous FP8 communication (#5997) 
* fix

* fix

* fix

* support async all2all

* support async op for all gather

* fix

* fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-08-14 14:08:19 +08:00
Guangyao Zhang
53cb9606bd
[Feature] llama shardformer fp8 support (#5938) 
* add llama shardformer fp8

* Llama Shardformer Parity

* fix typo

* fix all reduce

* fix pytest failure

* fix reduce op and move function to fp8.py

* fix typo
 2024-08-05 10:05:47 +08:00