github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-22 13:41:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

add some details in vit-b16 example (#46)

Browse Source
This commit is contained in:
ver217 2021-12-02 09:29:27 +08:00 committed by GitHub
parent e67dab92a9
commit 4da256a584
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/vit-b16/vit-b16.py
View File

@ -73,6 +73,6 @@ dali = dict(
engine = dict( engine = dict(
schedule=None, schedule=None,
gradient_handlers=None, gradient_handlers=None,
gradient_accumulation=16, gradient_accumulation=32,
gradient_clipping=1.0, gradient_clipping=1.0,
) )