github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-25 03:31:56 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc] remove obsolete API demo (#1833)

Browse Source
This commit is contained in:
binmakeswell
2022-11-08 18:00:49 +08:00
committed by GitHub
parent fba34efb5a
commit 9d3124ac8b
2 changed files with 0 additions and 61 deletions
Download Patch File Download Diff File Expand all files Collapse all files

31
README.md
View File

@@ -70,11 +70,6 @@
<li><a href="#Use-Docker">Use Docker</a></li>
<li><a href="#Community">Community</a></li>
<li><a href="#contributing">Contributing</a></li>
<li><a href="#Quick-View">Quick View</a></li>
<ul>
<li><a href="#Start-Distributed-Training-in-Lines">Start Distributed Training in Lines</a></li>
<li><a href="#Write-a-Simple-2D-Parallel-Model">Write a Simple 2D Parallel Model</a></li>
</ul>
<li><a href="#Cite-Us">Cite Us</a></li>
</ul>
@@ -311,32 +306,6 @@ Thanks so much to all of our amazing contributors!
<p align="right">(<a href="#top">back to top</a>)</p>
## Quick View
### Start Distributed Training in Lines
```python
parallel = dict(
pipeline=2,
tensor=dict(mode='2.5d', depth = 1, size=4)
)
```
### Start Heterogeneous Training in Lines
```python
zero = dict(
model_config=dict(
tensor_placement_policy='auto',
shard_strategy=TensorShardStrategy(),
reuse_fp16_shard=True
),
optimizer_config=dict(initial_scale=2**5, gpu_margin_mem_ratio=0.2)
)
```
<p align="right">(<a href="#top">back to top</a>)</p>
## Cite Us