github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-03 01:55:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

[hotfix] gpt example titans bug #2493 (#2494)

Browse Source
This commit is contained in:
Jiarui Fang
2023-01-18 12:04:18 +08:00
committed by GitHub
parent d565a24849
commit e327e95144
4 changed files with 58 additions and 49 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/language/gpt/titans/run.sh
View File

@@ -1,2 +1,3 @@
export DATA=/data/scratch/gpt_data/small-gpt-dataset.json
colossalai run --nproc_per_node=4 train_gpt.py --config ./configs/gpt2_small_zero3_pp1d.py --from_torch
DUMMY_DATA=--use_dummy_dataset
colossalai run --nproc_per_node=2 train_gpt.py --config ./configs/gpt2_small_zero3_pp1d.py --from_torch $DUMMY_DATA