[tutorial] updated hybrid parallel readme (#1928)

* [tutorial] updated hybrid parallel readme

* polish code
This commit is contained in:
Frank Lee
2022-11-13 03:25:01 +08:00
committed by GitHub
parent 807cbdb87d
commit 0486048453

View File

@@ -28,5 +28,5 @@ Current configuration setting on `config.py` is TP=2, PP=2.
colossalai run --nproc_per_node 4 train.py --config config.py colossalai run --nproc_per_node 4 train.py --config config.py
# train with synthetic data # train with synthetic data
colossalai run --nproc_per_node 4 train.py --config config.py colossalai run --nproc_per_node 4 train.py --config config.py -s
``` ```