github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-05-03 01:19:15 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,477 Commits 62 Branches 51 Tags
53cb9606bd86ed394e3a3d18a82fae5428f09155
Commit Graph

2 Commits

Author SHA1 Message Date
Guangyao Zhang
53cb9606bd [Feature] llama shardformer fp8 support (#5938) 
* add llama shardformer fp8

* Llama Shardformer Parity

* fix typo

* fix all reduce

* fix pytest failure

* fix reduce op and move function to fp8.py

* fix typo
 2024-08-05 10:05:47 +08:00
Hongxin Liu
5fd0592767 [fp8] support all-gather flat tensor (#5932) 2024-07-24 16:55:20 +08:00