github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-14 12:10:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
104cbbb313348e04cf83bda9f2dbfbe3b0f369fb
ColossalAI/colossalai/engine
History
HELSON e6d50ec107 [zero] adapt zero for unsharded parameters (#561) 
* support existing sharded and unsharded parameters in zero

* add unitest for moe-zero model init

* polish moe gradient handler
2022-03-31 18:34:11 +08:00
..
gradient_handler
[zero] adapt zero for unsharded parameters (#561)
2022-03-31 18:34:11 +08:00
ophooks
[zero] adapt zero for unsharded parameters (#561)
2022-03-31 18:34:11 +08:00
paramhooks
Fix/format colossalai/engine/paramhooks/(#350)
2022-03-11 15:50:28 +08:00
schedule
Refactored docstring to google style
2022-03-29 17:17:47 +08:00
__init__.py
Develop/experiments (#59)
2021-12-09 15:08:29 +08:00
_base_engine.py
Refactored docstring to google style
2022-03-29 17:17:47 +08:00