HELSON 6e51d296f0 [zero] migrate zero1&2 (#1878) ...

* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test

2022-11-11 09:26:40 +08:00

..

init_ctx

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

MemStatsCollectorStatic (#1765)

2022-11-07 16:49:03 +08:00

sharded_optim

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

sharded_param

[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)

2022-10-19 12:20:51 +08:00

utils

[zero] add constant placement policy (#1705)

2022-10-14 17:53:16 +08:00

__init__.py

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

zero_optimizer.py

[hotfix] fix zero's incompatibility with checkpoint in torch-1.12 (#1786)

2022-11-02 16:11:34 +08:00