HELSON b528eea0f0 [zero] add zero wrappers (#2523) ...

* [zero] add zero wrappers

* change names

* add wrapper functions to init

2023-01-29 17:52:58 +08:00

..

init_ctx

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

[Gemini] update API of the chunkmemstatscollector. (#2129)

2022-12-14 00:47:06 +08:00

sharded_optim

[zero] add zero wrappers (#2523)

2023-01-29 17:52:58 +08:00

sharded_param

[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)

2022-10-19 12:20:51 +08:00

utils

[ddp] add is_ddp_ignored (#2434)

2023-01-11 12:22:45 +08:00

__init__.py

[Gemini] add GeminiAdamOptimizer (#1960)

2022-11-16 14:44:28 +08:00