github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-05-09 17:08:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
0e199d71e8
ColossalAI/tests/test_optimizer
History
LuGY 105c5301c3
[zero]added hybrid adam, removed loss scale in adam (#527) 
* [zero]added hybrid adam, removed loss scale of adam

* remove useless code
2022-03-25 18:03:54 +08:00
..
unittest_cpu_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00
unittest_fused_adam_kernel.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00
unittest_fused_adam.py [cuda] modify the fused adam, support hybrid of fp16 and fp32 (#497) 2022-03-25 14:15:53 +08:00
unittest_hybrid_adam.py [zero]added hybrid adam, removed loss scale in adam (#527) 2022-03-25 18:03:54 +08:00