github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-28 12:20:38 +00:00
Code Issues Packages Projects Releases Wiki Activity
320 Commits 59 Branches 51 Tags
666cfd094a767074ca921cf5cfd5fcbfd2ad327d
Commit Graph

2 Commits

Author SHA1 Message Date
LuGY
105c5301c3 [zero]added hybrid adam, removed loss scale in adam (#527) 
* [zero]added hybrid adam, removed loss scale of adam

* remove useless code
 2022-03-25 18:03:54 +08:00
LuGY
6a3f9fda83 [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 2022-03-25 14:15:53 +08:00