ver217 51b9a49655 [zero] add zero optimizer for ColoTensor (#1046) ...

* add zero optimizer

* torch ok

* unit test ok

* polish code

* fix bugs

* polish unit test

* polish zero optim

* polish colo ddp v2

* refactor folder structure

* add comment

* polish unit test

* polish zero optim

* polish unit test

2022-06-02 12:13:15 +08:00

..

__init__.py

[zero] add zero optimizer for ColoTensor (#1046)

2022-06-02 12:13:15 +08:00

colossalai_optimizer.py

Develop/experiments (#59)

2021-12-09 15:08:29 +08:00

cpu_adam.py

[zero] improve adaptability for not-shard parameters (#708)

2022-04-11 13:38:51 +08:00

fused_adam.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

fused_lamb.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

fused_sgd.py

polish optimizer docstring (#619)

2022-04-01 16:27:03 +08:00

hybrid_adam.py

fix bugs in CPU adam (#633)

2022-04-02 17:04:05 +08:00

lamb.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

lars.py

Fixed docstring in colossalai (#171)

2022-01-21 10:44:30 +08:00

utils.py

fix bugs in CPU adam (#633)

2022-04-02 17:04:05 +08:00