Jiarui Fang 1aad903c15 [tensor] redistribute among different process groups (#1247) ...

* make it faster

* [tensor] rename convert_to_dist -> redistribute

* [tensor] ShardSpec and ReplicaSpec

* [tensor] redistribute among diff pgs

* polish code

2022-07-12 10:24:05 +08:00

..

__init__.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

colo_parameter.py

[tensor] add zero_like colo op, important for Optimizer (#1236)

2022-07-08 14:55:27 +08:00

colo_tensor.py

[tensor] redistribute among different process groups (#1247)

2022-07-12 10:24:05 +08:00

compute_spec.py

[ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168)

2022-06-24 13:08:54 +08:00

const.py

[Tensor] init ColoParameter (#914)

2022-05-06 12:57:14 +08:00

dist_spec_mgr.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

distspec.py

[polish] polish __repr__ for ColoTensor, DistSpec, ProcessGroup (#1235)

2022-07-08 13:25:57 +08:00

op_wrapper.py

[tensor] refactor colo-tensor (#992)

2022-05-19 12:44:59 +08:00

param_op_hook.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

process_group.py

[tensor] redistribute among different process groups (#1247)

2022-07-12 10:24:05 +08:00

tensor_spec.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

utils.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00