ver217 ad536e308e [tensor] refactor colo-tensor (#992) ...

* refactor colo-tensor and update linear op

* polish code

* polish code

* update ops and unit tests

* update unit tests

* polish code

* rename dist_spec module

* polish code

* polish code

* remove unneeded import

* fix pipelinable

2022-05-19 12:44:59 +08:00

..

data_sampler

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

model

[tensor] refactor colo-tensor (#992)

2022-05-19 12:44:59 +08:00

multi_tensor_apply

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

profiler

[utils] refactor profiler (#837)

2022-04-24 17:03:59 +08:00

tensor_detector

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

__init__.py

Init Conext supports lazy allocate model memory (#842)

2022-04-22 18:03:35 +08:00

activation_checkpoint.py

[util] fixed activation checkpointing on torch 1.9 (#719)

2022-04-12 09:35:45 +08:00

checkpointing.py

polish checkpoint docstring (#637)

2022-04-02 13:34:33 +08:00

common.py

[zero] refactor memstats collector (#706)

2022-04-11 10:46:08 +08:00

cuda.py

[refactor] refactor the memory utils (#715)

2022-04-11 16:47:57 +08:00

memory.py

[gemini] APIs to set cpu memory capacity (#809)

2022-04-19 16:05:22 +08:00

moe.py

Refactored docstring to google style

2022-03-29 17:17:47 +08:00

timer.py

Refactored docstring to google style

2022-03-29 17:17:47 +08:00