github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-09 20:14:29 +00:00
Code Issues Packages Projects Releases Wiki Activity

[tutorial] edited hands-on practices (#1899)

Browse Source 
* Add handson to ColossalAI.

* Change names of handsons and edit sequence parallel example.

* Edit wrong folder name

* resolve conflict

* delete readme
This commit is contained in:
BoxiangW
2022-11-11 04:08:17 -05:00
committed by GitHub
parent d9bf83e084
commit ca6e75bc28
121 changed files with 20464 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/tutorial/opt/zero/run.sh Normal file
View File

@@ -0,0 +1 @@
env OMP_NUM_THREADS=16 torchrun --standalone --nproc_per_node=4 train_gpt_demo.py --tp_degree=2 --placement='cpu' 2>&1 | tee run.log