github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-08 12:30:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

[Tensor] add hybrid device demo and fix bugs (#1059)

Browse Source
This commit is contained in:
Ziyue Jiang
2022-06-03 12:09:49 +08:00
committed by GitHub
parent b167258b6a
commit df9dcbbff6
5 changed files with 94 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/utils/model/colo_init_context.py
View File

@@ -92,4 +92,5 @@ class ColoInitContext(InsertPostInitMethodToModuleSubClasses):
setattr(submodule, param_name, colo_param)
colo_param.shared_param_modules.append(submodule)
module.to(self._device)
ColoModulize(module)