mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2025-10-08 21:34:29 +00:00
ca6e75bc28
* Add handson to ColossalAI. * Change names of handsons and edit sequence parallel example. * Edit wrong folder name * resolve conflict * delete readme
2 lines
133 B
Bash
2 lines
133 B
Bash
env OMP_NUM_THREADS=16 torchrun --standalone --nproc_per_node=4 train_gpt_demo.py --tp_degree=2 --placement='cpu' 2>&1 | tee run.log
|