github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-03 18:19:58 +00:00
Code Issues Packages Projects Releases Wiki Activity

[autoparallel] add shard option (#2696)

Browse Source 
* [autoparallel] add shard option

* polish
This commit is contained in:
YuliangLiu0306
2023-02-15 13:48:28 +08:00
committed by GitHub
parent 5b24987fa7
commit 21d6a48f4d
15 changed files with 176 additions and 104 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
colossalai/auto_parallel/tensor_shard/solver/solver.py
View File

@@ -33,7 +33,7 @@ class Solver:
solution_numbers: int = 1,
forward_only: bool = False,
memory_increasing_coefficient: float = 1.3,
verbose=True):
verbose=False):
'''
Solver class will integrate information provided by the components and use ILP solver to find a possible optimal strategies combination for target computing graph.
Argument: