HELSON a9b8300d54 [zero] improve adaptability for not-shard parameters (#708) ...

* adapt post grad hooks for not-shard parameters
* adapt optimizer for not-shard parameters
* offload gradients for not-replicated parameters

2022-04-11 13:38:51 +08:00

..

__init__.py

fix bugs in CPU adam (#633)

2022-04-02 17:04:05 +08:00

colossalai_optimizer.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

cpu_adam.py

[zero] improve adaptability for not-shard parameters (#708)

2022-04-11 13:38:51 +08:00

fused_adam.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

fused_lamb.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

fused_sgd.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

hybrid_adam.py

fix bugs in CPU adam (#633)

2022-04-02 17:04:05 +08:00

lamb.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

lars.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

utils.py

fix bugs in CPU adam (#633)

2022-04-02 17:04:05 +08:00