github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-20 09:01:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

[pipeline/chimera] test chimera | fix bug of initializing (#1615)

Browse Source 
* [pipeline/tuning] improve dispatch performance both time and space cost

* [pipeline/converge] add interface for testing convergence

* [NFC] polish colossalai/utils/multi_tensor_apply/multi_tensor_apply.py code style

* Update PipelineBase.py

* [pipeline/chimera] reconstruct PipelineBase and Worker to support more feasible custom schedule | finish Chimera

* [pipeline/chimera] test chimera | fix bug of initializing
This commit is contained in:
Kirigaya Kazuto
2022-09-20 18:00:39 +08:00
committed by GitHub
parent 504ff1d101
commit 170fa81095
13 changed files with 342 additions and 144 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
colossalai/pipeline/pipelinable.py
View File

@@ -110,7 +110,8 @@ class PipelinableContext(InsertPostInitMethodToModuleSubClasses):
name_list.append((name, param))
for name, param in name_list:
delattr(module, name)
if hasattr(module, name):
delattr(module, name)
setattr(module, name, ColoParameter.from_torch_tensor(tensor=param.data, requires_grad=param.requires_grad))
def to_layer_list(self, exec_seq=None):