HELSON 63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) ...

* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol

2022-12-09 18:09:17 +08:00

..

update

[zero] add L2 gradient clipping for ZeRO (#2112)

2022-12-09 18:09:17 +08:00

test_gemini_manager.py

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

test_param_op.py

[test] align model name with the file name. (#2045)

2022-11-30 15:45:26 +08:00

test_runtime_mem_tracer.py

[gemini] get the param visited order during runtime (#2108)

2022-12-09 16:13:03 +08:00