LuGY 839847b7d7 [zero]support zero2 with gradient accumulation (#4511) ...

* support gradient accumulation with zero2

* fix type

2023-08-25 13:44:07 +08:00

..

gemini

[gemini] improve compatibility and add static placement policy (#4479)

2023-08-24 09:29:25 +08:00

legacy

[nfc] fix typo colossalai/zero (#3923)

2023-06-08 00:01:29 +08:00

low_level

[zero]support zero2 with gradient accumulation (#4511)

2023-08-25 13:44:07 +08:00

__init__.py

[gemini] improve compatibility and add static placement policy (#4479)

2023-08-24 09:29:25 +08:00

wrapper.py

[gemini] improve compatibility and add static placement policy (#4479)

2023-08-24 09:29:25 +08:00