github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-08-28 12:43:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,767 Commits 58 Branches 51 Tags 238 MiB
cloud/coati
Commit Graph

1 Commits

Author SHA1 Message Date
FoolPlayer
dd2bf02679 [shardformer] support SAM (#4231) 
* 1.support sam 2.add fused qkv for nn.Linear

* update utils support set element in list

* overtwrite SamVisionAttention foward to use DropoutForParallelInput

* remove unused code
 2023-08-15 23:25:14 +08:00