github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-07 20:10:17 +00:00
Code Issues Packages Projects Releases Wiki Activity

[doc]fix

Browse Source
This commit is contained in:
jiangmingyan
2023-05-23 17:53:11 +08:00
parent 8aa1fb2c7f
commit 278fcbc444
4 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/features/gradient_accumulation_with_booster.md
View File

@@ -128,7 +128,7 @@ for idx, (img, label) in enumerate(train_dataloader):
### Step 6. Invoke Training Scripts
To verify gradient accumulation, we can just check the change of parameter values. When gradient accumulation is set, parameters are only updated in the last step. You can run the script using this command:
```shell
colossalai run --nproc_per_node 1 train.py --config config.py
colossalai run --nproc_per_node 1 train.py
```
You will see output similar to the text below. This shows gradient is indeed accumulated as the parameter is not updated

2
docs/source/en/features/gradient_clipping_with_booster.md
View File

@@ -136,7 +136,7 @@ for idx, (img, label) in enumerate(train_dataloader):
You can run the script using this command:
```shell
colossalai run --nproc_per_node 1 train.py --config config/config.py
colossalai run --nproc_per_node 1 train.py
```
<!-- doc-test-command: torchrun --standalone --nproc_per_node=1 gradient_clipping_with_booster.py -->