CsRic f3403ff98e [embeddings] add already_split_along_rank flag for tablewise mode (#1584)

2022-09-13 10:50:34 +08:00

..

layers

[embeddings] add already_split_along_rank flag for tablewise mode (#1584)

2022-09-13 10:50:34 +08:00

__init__.py

[ddp] refactor ColoDDP and ZeroDDP (#1146)

2022-06-21 16:35:23 +08:00

data_parallel.py

[NFC] polish colossalai/nn/parallel/data_parallel.py code style (#1570)

2022-09-08 22:11:04 +08:00

reducer.py

[ddp] ColoDDP uses bucket all-reduce (#1177)

2022-06-29 10:34:13 +08:00