Frank Lee ae1b58cd16 [tensor] added linear implementation for the new sharding spec (#1416) ...

* [tensor] added linear implementation for the new sharding spec

* polish code

2022-08-12 11:33:09 +08:00

..

__init__.py

[hotfix] fix no optimizer in save/load (#1363)

2022-07-26 10:53:53 +08:00

colo_parameter.py

[Optimizer] Remove useless ColoOptimizer (#1312)

2022-07-14 16:57:48 +08:00

colo_tensor.py

[colotensor] add Tensor.view op and its unit test (#1343)

2022-07-21 10:53:15 +08:00

compute_spec.py

[colotensor] add Tensor.view op and its unit test (#1343)

2022-07-21 10:53:15 +08:00

const.py

[Tensor] init ColoParameter (#914)

2022-05-06 12:57:14 +08:00

dist_spec_mgr.py

[hotfix] Dist Mgr gather torch version (#1284)

2022-07-13 00:18:56 +08:00

distspec.py

[tensor] distributed checkpointing for parameters (#1240)

2022-07-12 15:51:06 +08:00

op_wrapper.py

[doc] update rst and docstring (#1351)

2022-07-21 15:54:53 +08:00

param_op_hook.py

[doc] update rst and docstring (#1351)

2022-07-21 15:54:53 +08:00

process_group.py

[hotfix] adapt ProcessGroup and Optimizer to ColoTensor (#1388)

2022-07-29 19:33:24 +08:00

shape_consistency.py

[tensor] add shape consistency feature to support auto spec transform (#1418)

2022-08-10 11:29:17 +08:00

sharding_spec.py

[tensor] added linear implementation for the new sharding spec (#1416)

2022-08-12 11:33:09 +08:00

tensor_spec.py

[refactor] move process group from _DistSpec to ColoTensor. (#1203)

2022-07-06 16:15:16 +08:00

utils.py

[doc] update rst and docstring (#1351)

2022-07-21 15:54:53 +08:00