HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ... * [zero] fix gradient clipping in hybrid parallelism * [testing] change model name to avoid pytest warning * [hotfix] fix unit testing		2023-01-29 15:09:57 +08:00
..
__init__.py	refactored grad scaler (#338)	2022-03-11 15:50:28 +08:00
base_grad_scaler.py	[NFC] polish amp.naive_amp.grad_scaler code style	2022-11-09 13:38:15 +08:00
constant_grad_scaler.py	[doc] improved docstring in the amp module (#857)	2022-04-25 13:42:17 +08:00
dynamic_grad_scaler.py	[zero] fix gradient clipping in hybrid parallelism (#2521)	2023-01-29 15:09:57 +08:00