YuliangLiu0306 2b7dca44b5 [fx]get communication size between partitions (#1224) ...

* [CLI] add CLI launcher

* Revert "[CLI] add CLI launcher"

This reverts commit df7e6506d4.

* [fx]get communication size between partitions.

* polish

2022-07-07 16:22:00 +08:00

..

amp

[hotfix]different overflow status lead to communication stuck. (#1175)

2022-06-27 09:53:57 +08:00

builder

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

cli

[hotfix] fix some bugs caused by size mismatch. (#1011)

2022-05-23 14:02:28 +08:00

communication

[hotfix]fixed p2p process send stuck (#1181)

2022-06-28 14:41:11 +08:00

context

[usability] improved error messages in the context module (#856)

2022-04-25 13:42:31 +08:00

engine

[hotfix]fix some bugs caused by refactored schedule. (#1148)

2022-06-21 22:46:30 +08:00

fx

[fx]get communication size between partitions (#1224)

2022-07-07 16:22:00 +08:00

gemini

make AutoPlacementPolicy configurable (#1191)

2022-06-30 15:18:30 +08:00

kernel

[optim] refactor fused sgd (#1134)

2022-06-20 11:19:38 +08:00

logging

[doc] improved docstring in the logging module (#861)

2022-04-25 13:42:00 +08:00

nn

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

pipeline

[pipeline]add customized policy (#1139)

2022-06-21 15:23:41 +08:00

registry

Remove duplication registry (#1078)

2022-06-08 07:47:24 +08:00

tensor

[tensor] improve robustness of class 'ProcessGroup' (#1223)

2022-07-07 13:55:24 +08:00

testing

[test] skip tests when not enough GPUs are detected (#1090)

2022-06-09 17:19:13 +08:00

trainer

fix issue #1080 (#1071)

2022-06-07 17:21:11 +08:00

utils

[checkpoint] make unitest faster (#1217)

2022-07-06 17:39:46 +08:00

zero

warmup ratio configration (#1192)

2022-06-30 15:23:50 +08:00

__init__.py

[NFC] polish __init__.py code style (#965)

2022-05-17 10:25:06 +08:00

constants.py

fix typo in constants (#1027)

2022-05-26 08:45:08 +08:00

core.py

[Tensor] distributed view supports inter-process hybrid parallel (#1169)

2022-06-27 09:45:26 +08:00

global_variables.py

[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)

2022-03-21 13:35:04 +08:00

initialize.py

[ddp] supported customized torch ddp configuration (#1123)

2022-06-15 18:11:53 +08:00