mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-01-22 21:24:31 +00:00
update examples and sphnix docs for the new api (#63)
This commit is contained in:
@@ -18,6 +18,15 @@ fp16 = dict(
|
||||
initial_scale=2 ** 8
|
||||
)
|
||||
|
||||
# optional
|
||||
# configuration for zero
|
||||
# you can refer to the Zero Redundancy optimizer and zero offload section for details
|
||||
# https://www.colossalai.org/zero.html
|
||||
zero = dict(
|
||||
level=<int>,
|
||||
...
|
||||
)
|
||||
|
||||
# optional
|
||||
# if you are using complex gradient handling
|
||||
# otherwise, you do not need this in your config file
|
||||
|
||||
Reference in New Issue
Block a user