Jiarui Fang a444633d13 warmup ratio configration (#1192)

2022-06-30 15:23:50 +08:00

..

__init__.py

[refactor] remove old zero code (#517)

2022-03-25 14:54:39 +08:00

_utils.py

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

reduce_scatter.py

[zero] add sharded grad and refactor grad hooks for ShardedModel (#287)

2022-03-11 15:50:28 +08:00

sharded_model_v2.py

warmup ratio configration (#1192)

2022-06-30 15:23:50 +08:00

utils.py

[zero] refactor ShardedParamV2 for convenience (#742)

2022-04-13 14:54:26 +08:00