HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ...

* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing

2023-01-29 15:09:57 +08:00

..

grad_scaler

[zero] fix gradient clipping in hybrid parallelism (#2521)

2023-01-29 15:09:57 +08:00

__init__.py

[NFC] polish colossalai/amp/naive_amp/__init__.py code style (#1905)

2022-11-11 17:49:18 +08:00

_fp16_optimizer.py

[setup] support pre-build and jit-build of cuda kernels (#2374)

2023-01-06 20:50:26 +08:00

_utils.py

[NFC] polish colossalai/amp/naive_amp/_utils.py code style (#1816)

2022-11-09 12:08:47 +08:00

naive_amp.py

[amp] add gradient clipping for unit tests (#2283)

2023-01-04 11:59:56 +08:00