ver217 0c51ff2c13 [hotfix] ZeroDDP use new process group (#1333) ...

* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests

2022-07-18 14:14:52 +08:00

..

__init__.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

colo_parameter.py

[Optimizer] Remove useless ColoOptimizer (#1312)

2022-07-14 16:57:48 +08:00

colo_tensor.py

[hotfix] fix unit test test_module_spec (#1321)

2022-07-15 14:02:32 +08:00

compute_spec.py

[ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168)

2022-06-24 13:08:54 +08:00

const.py

[Tensor] init ColoParameter (#914)

2022-05-06 12:57:14 +08:00

dist_spec_mgr.py

[hotfix] Dist Mgr gather torch version (#1284)

2022-07-13 00:18:56 +08:00

distspec.py

[tensor] distributed checkpointing for parameters (#1240)

2022-07-12 15:51:06 +08:00

op_wrapper.py

[tensor] refactor colo-tensor (#992)

2022-05-19 12:44:59 +08:00

param_op_hook.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

process_group.py

[hotfix] ZeroDDP use new process group (#1333)

2022-07-18 14:14:52 +08:00

tensor_spec.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

utils.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00