HELSON e37f3db40c [gemini] add arguments (#2046) ...

* [zero] fix testing parameters

* [gemini] add arguments

* add docstrings

2022-11-30 16:40:13 +08:00

..

layers

[embedding] rename FreqAwareEmbedding -> CachedEmbedding (#1699)

2022-10-13 22:22:27 +08:00

__init__.py

[Gemini] make gemini usage simple (#1821)

2022-11-08 15:53:13 +08:00

data_parallel.py

[hotfix] add bert test for gemini fwd bwd (#2035)

2022-11-29 11:19:52 +08:00

gemini_parallel.py

[gemini] add arguments (#2046)

2022-11-30 16:40:13 +08:00

reducer.py

[ddp] ColoDDP uses bucket all-reduce (#1177)

2022-06-29 10:34:13 +08:00

utils.py

[feature] A new ZeRO implementation (#1644)

2022-10-09 09:18:51 +08:00