github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-04-11 14:43:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
63fbba3c19b5fe98a3f166eca9e78c52f509f1b5
ColossalAI/colossalai/gemini/chunk
History
HELSON 63fbba3c19 [zero] add L2 gradient clipping for ZeRO (#2112) 
* [zero] add L2 gradient clipping

* [testing] add MlpModel

* [zero] add unit test for grad clipping

* fix atol
2022-12-09 18:09:17 +08:00
..
__init__.py
[Gemini] NFC, polish search_chunk_configuration (#2107)
2022-12-09 15:00:39 +08:00
chunk.py
[zero] add L2 gradient clipping for ZeRO (#2112)
2022-12-09 18:09:17 +08:00
manager.py
[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786)
2022-11-02 16:11:34 +08:00
search_utils.py
[Gemini] NFC, polish search_chunk_configuration (#2107)
2022-12-09 15:00:39 +08:00
utils.py
[zero] add chunk init function for users (#1729)
2022-10-18 16:31:22 +08:00