Boyuan Yao cfe2a9bd90 [autoparallel] memory estimation for shape consistency (#2144) ...

* [fx] metainfo class for auto parallel

* [fx] add unit test for linear metainfo

* [fx] fix bwd param for linear

* [fx] modify unit test

* [fx] modify unit test

* [fx] modify import

* [fx] modify import

* [fx] modify import

* [fx] move meta profiler to auto parallel

* [fx] add conv metainfo class

* [fx] restore profiler

* [fx] restore meta profiler

* [autoparallel] modify unit test

* [fx] modify unit test

* [autoparallel] add batchnorm metainfo class

* [autoparallel] fix batchnorm unit test function declaration

* [fx] restore profiler

* [fx] add relu metainfo class

* [fx] restore profiler

* [autoparallel] modify metainfo input

* [autoparallel] add pooling metainfo

* [autoparallel] add F.linear metainfo generator

* [autoparallel] add binary elementwise metainfo

* [fx] recover profiler

* [autoparallel] fix forward memory calculation

* [autoparallel] modify constants.py

* [autoparallel] remove redundant print

* [autoparallel] add F.conv metainfo

* [autoparallel] linear fix

* [autoparallel] memory estimation for communication actions

* [autoparallel] fix docstring

* [autoparallel] fix variables name

2022-12-21 10:39:37 +08:00

..

__init__.py

[Gemini] ParamOpHook -> ColoParamOpHook (#2080)

2022-12-05 17:11:06 +08:00

colo_parameter.py

[Gemini] ParamOpHook -> ColoParamOpHook (#2080)

2022-12-05 17:11:06 +08:00

colo_tensor.py

[Gemini] GeminiDPP convert to PyTorch Module. (#2151)

2022-12-20 10:19:36 +08:00

comm_spec.py

[autoparallel] add experimental permute handler (#2029)

2022-11-27 20:26:52 +08:00

compute_spec.py

[NFC] polish doc style for ColoTensor (#1457)

2022-08-16 09:21:05 +08:00

const.py

[Tensor] init ColoParameter (#914)

2022-05-06 12:57:14 +08:00

dist_spec_mgr.py

[autoparallel] fix bugs caused by negative dim key (#1808)

2022-11-08 17:03:50 +08:00

distspec.py

[Doc] add more doc for ColoTensor. (#1458)

2022-08-16 10:38:41 +08:00

op_wrapper.py

[doc] update rst and docstring (#1351)

2022-07-21 15:54:53 +08:00

param_op_hook.py

[NFC] polish comments for Chunk class (#2116)

2022-12-12 15:39:31 +08:00

process_group.py

[doc] update docstring in ProcessGroup (#1468)

2022-08-19 13:41:57 +08:00

shape_consistency.py

[autoparallel] memory estimation for shape consistency (#2144)

2022-12-21 10:39:37 +08:00

sharding_spec.py

[autoparallel] fix bugs caused by negative dim key (#1808)

2022-11-08 17:03:50 +08:00

tensor_spec.py

[autoparallel] fix bugs caused by negative dim key (#1808)

2022-11-08 17:03:50 +08:00

utils.py

[autoparallel] mix gather (#1977)

2022-11-23 21:49:17 +08:00