github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-02 20:35:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,965 Commits 51 Branches 51 Tags 235 MiB
e545a871b8
Commit Graph

2 Commits

Author SHA1 Message Date
Jianghai
e545a871b8 [Hotfix] Fix accuracy and align attention method api with Triton kernel (#5229) 
* fix accuracy

* alignment in attention

* fix attention

* fix

* fix bugs

* fix bugs

* fix bugs
 2024-01-11 13:46:14 +00:00
Jianghai
bfd9b1b494 [Inference] Pytorch Attention func, pad&nopad input support (#5219) 
* add attn

* add attention test

* fix attn forward

* fix decoding
 2024-01-11 13:44:06 +00:00