github/ColossalAI

mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-29 05:26:21 +00:00

Files

History

Super Daniel 6d559ea614 [sc] add examples for auto checkpoint. (#1880 )

2022-11-10 20:50:15 +08:00

..

auto_ckpt_demo.ipynb

[sc] add examples for auto checkpoint. (#1880 )

2022-11-10 20:50:15 +08:00

auto_parallel_demo.py

[example] migrate diffusion and auto_parallel hands-on (#1871 )

2022-11-10 15:31:46 +08:00

bench_utils.py

[sc] add examples for auto checkpoint. (#1880 )

2022-11-10 20:50:15 +08:00

README.md

[example] migrate diffusion and auto_parallel hands-on (#1871 )

2022-11-10 15:31:46 +08:00

README.md

Train ResNet on CIFAR10 with auto_parallel

Prepare Dataset

We use CIFAR10 dataset in this example. The dataset will be downloaded to ./data by default. If you wish to use customized directory for the dataset. You can set the environment variable DATA via the following command.

export DATA=/path/to/data

Run on 2*2 device mesh

colossalai run --nproc_per_node 4 auto_parallel_demo.py