Jiarui Fang 1aad903c15 [tensor] redistribute among different process groups (#1247) ...

* make it faster

* [tensor] rename convert_to_dist -> redistribute

* [tensor] ShardSpec and ReplicaSpec

* [tensor] redistribute among diff pgs

* polish code

2022-07-12 10:24:05 +08:00

..

_utils

[refactor] remove gpc dependency in colotensor's _ops (#1189)

2022-07-04 18:54:37 +08:00

test_addmm_tp.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_chunk.py

[refactor] move chunk and chunkmgr to directory gemini (#1182)

2022-06-29 13:31:02 +08:00

test_context.py

[refactory] add nn.parallel module (#1068)

2022-06-06 15:34:41 +08:00

test_dist_spec_mgr.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_embedding_bag_tp.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_embedding_tp.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_gpt.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_linear_tp.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_loss_func.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_model.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00

test_module_spec.py

[tensor] redistribute among different process groups (#1247)

2022-07-12 10:24:05 +08:00

test_op.py

[tensor] redistribute among different process groups (#1247)

2022-07-12 10:24:05 +08:00

test_parameter.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

test_tensor.py

[tensor] redistribute among different process groups (#1247)

2022-07-12 10:24:05 +08:00

test_zero_optim.py

[tensor] a shorter shard and replicate spec (#1245)

2022-07-11 15:51:48 +08:00