Jiarui Fang 33f4412102 [Gemini] use MemStats to store the tracing data. Seperate it from Collector. (#2084)

2022-12-06 16:43:06 +08:00

..

init_ctx

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

[Gemini] use MemStats to store the tracing data. Seperate it from Collector. (#2084)

2022-12-06 16:43:06 +08:00

sharded_optim

[zero] test gradient accumulation (#1964)

2022-11-29 13:00:30 +08:00

sharded_param

[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)

2022-10-19 12:20:51 +08:00

utils

[Gemini] ParamOpHook -> ColoParamOpHook (#2080)

2022-12-05 17:11:06 +08:00

__init__.py

[Gemini] add GeminiAdamOptimizer (#1960)

2022-11-16 14:44:28 +08:00