github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-05 23:54:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Revert "[feature] new zero implementation (#1623)" (#1643)

Browse Source 
This reverts commit 5be118f405.
This commit is contained in:
Jiarui Fang
2022-09-26 10:06:03 +08:00
committed by GitHub
parent 5be118f405
commit c5d39215f6
29 changed files with 1535 additions and 913 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/zero/utils/zero_hook_v2.py
View File

@@ -54,8 +54,8 @@ class ZeROHookV2(ParamOpHook):
@contextmanager
def switch_training_phase(self, training_phase: TrainingPhase = TrainingPhase.BACKWARD):
old_training_phase = self._training_phase
try:
old_training_phase = self._training_phase
self._training_phase = training_phase
yield
finally: