ver217 0c51ff2c13 [hotfix] ZeroDDP use new process group (#1333) ...

* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests

2022-07-18 14:14:52 +08:00

..

_ops

[hotfix] fix shape error in backward when using ColoTensor (#1298)

2022-07-13 23:06:12 +08:00

graph

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

layer

[NFC] polish colossalai/nn/layer/wrapper/pipeline_wrapper.py code style (#1303)

2022-07-13 19:01:07 +08:00

loss

[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)

2022-07-07 19:17:23 +08:00

lr_scheduler

[NFC] polish colossalai/nn/lr_scheduler/onecycle.py code style (#1269)

2022-07-13 12:08:21 +08:00

metric

[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)

2022-04-02 16:12:04 +08:00

optimizer

[checkpoint] add ColoOptimizer checkpointing (#1316)

2022-07-15 09:52:55 +08:00

parallel

[hotfix] ZeroDDP use new process group (#1333)

2022-07-18 14:14:52 +08:00

__init__.py

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

init.py

[NFC] polish colossalai/nn/init.py code style (#1292)

2022-07-13 10:51:55 +08:00