Jiarui Fang 363fc2861a [embeddings] more detailed timer (#1692)

2022-10-12 12:01:21 +08:00

..

layers

[embeddings] more detailed timer (#1692)

2022-10-12 12:01:21 +08:00

__init__.py

[ddp] refactor ColoDDP and ZeroDDP (#1146)

2022-06-21 16:35:23 +08:00

data_parallel.py

[feature] A new ZeRO implementation (#1644)

2022-10-09 09:18:51 +08:00

reducer.py

[ddp] ColoDDP uses bucket all-reduce (#1177)

2022-06-29 10:34:13 +08:00

utils.py

[feature] A new ZeRO implementation (#1644)

2022-10-09 09:18:51 +08:00