HELSON 6e51d296f0 [zero] migrate zero1&2 (#1878) ...

* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test

2022-11-11 09:26:40 +08:00

..

bookkeeping

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

__init__.py

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

_utils.py

[refactor] zero directory (#724)

2022-04-11 23:13:02 +08:00

low_level_optim.py

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

sharded_optim_v2.py

fix move fp32 shards (#1604)

2022-09-16 17:33:16 +08:00