github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-02 01:28:31 +00:00
Code Issues Packages Projects Releases Wiki Activity

[autoparallel] resnet block runtime apply (#1709)

Browse Source 
* [autoparallel] resnet block runtime apply

* seperate buffer and parameter in MemoryCost

* polish code

* add comments and todos

* fix test issue
This commit is contained in:
YuliangLiu0306
2022-10-17 13:37:38 +08:00
committed by GitHub
parent b0a23dc4fc
commit 845ff4a47a
11 changed files with 277 additions and 27 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
colossalai/auto_parallel/tensor_shard/solver/solver.py
View File

@@ -169,10 +169,7 @@ class Solver:
else:
communication_costs.append(origin_communication_cost)
memory_costs.append(memory_cost)
# if isinstance(memory_cost, tuple):
# memory_costs.append(memory_cost[0])
# else:
# memory_costs.append(memory_cost)
compute_costs = np.array(compute_costs)
communication_costs = np.array(communication_costs)
memory_costs = np.array(memory_costs)