HELSON e7d3afc9cc [optimizer] add div_scale for optimizers (#2117) ...

* [optimizer] add div_scale for optimizers

* [zero] use div_scale in zero optimizer

* fix testing error

2022-12-12 17:58:57 +08:00

..

__init__.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

cpu_optim.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

fused_optim.pyi

[optimizer] add div_scale for optimizers (#2117)

2022-12-12 17:58:57 +08:00

layer_norm.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

moe.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

multihead_attention.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

scaled_masked_softmax.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00

scaled_upper_triang_masked_softmax.pyi

[kernel] move all symlinks of kernel to colossalai._C (#1971)

2022-11-17 13:42:33 +08:00