HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ...

* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing

2023-01-29 15:09:57 +08:00

..

apex_amp

[NFC] polish colossalai/amp/apex_amp/__init__.py code style (#1853)

2022-11-09 14:49:42 +08:00

naive_amp

[zero] fix gradient clipping in hybrid parallelism (#2521)

2023-01-29 15:09:57 +08:00

torch_amp

[NFC] polish colossalai/amp/torch_amp/torch_amp.py code style (#2290)

2023-01-04 15:09:57 +08:00

__init__.py

[refactor] zero directory (#724)

2022-04-11 23:13:02 +08:00

amp_type.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00