github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-26 01:35:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,697 Commits 62 Branches 51 Tags
ac178ca5c17ca751ff9df38be81da2b4a005fc0d
Commit Graph

6 Commits

Author SHA1 Message Date
flybird1111
7a3dfd0c64 [shardformer] update shardformer to use flash attention 2 (#4392) 
* cherry-pick flash attention 2

cherry-pick flash attention 2

* [shardformer] update shardformer to use flash attention 2

[shardformer] update shardformer to use flash attention 2, fix

[shardformer] update shardformer to use flash attention 2, fix

[shardformer] update shardformer to use flash attention 2, fix
 2023-08-15 23:25:14 +08:00
flybird1111
25c57b9fb4 [fix] coloattention support flash attention 2 (#4347) 
Improved ColoAttention interface to support flash attention 2. Solved #4322
 2023-08-04 13:46:22 +08:00
Frank Lee
dd14783f75 [kernel] fixed repeated loading of kernels (#2549) 
* [kernel] fixed repeated loading of kernels

* polish code

* polish code
 2023-02-03 09:47:13 +08:00
zbian
6877121377 updated flash attention api 2022-11-15 15:25:39 +08:00
ver217
f68eddfb3d refactor kernel (#142) 2022-01-13 16:47:17 +08:00
shenggan
5c3843dc98 add colossalai kernel module (#55) 2021-12-21 12:19:52 +08:00