Jiarui Fang f7e276fa71 [Gemini] add GeminiAdamOptimizer (#1960)

2022-11-16 14:44:28 +08:00

..

init_ctx

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

shard_utils

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

sharded_model

MemStatsCollectorStatic (#1765)

2022-11-07 16:49:03 +08:00

sharded_optim

[zero] fix memory leak for zero2 (#1955)

2022-11-16 11:43:24 +08:00

sharded_param

[NFC] polish colossalai/zero/sharded_param/__init__.py code style (#1717)

2022-10-19 12:20:51 +08:00

utils

[zero] add constant placement policy (#1705)

2022-10-14 17:53:16 +08:00

__init__.py

[Gemini] add GeminiAdamOptimizer (#1960)

2022-11-16 14:44:28 +08:00