ver217 1f894e033f [gemini] zero supports gemini (#1093) ...

* add placement policy

* add gemini mgr

* update mem stats collector

* update zero

* update zero optim

* fix bugs

* zero optim monitor os

* polish unit test

* polish unit test

* add assert

2022-06-10 14:48:28 +08:00

..

graph

[Graph] building computing graph with ColoTensor, Linear only (#917)

2022-05-07 17:10:37 +08:00

__init__.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00

chunk.py

[gemini] zero supports gemini (#1093)

2022-06-10 14:48:28 +08:00

colo_parameter.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00

colo_tensor.py

[tensor] refactor parallel action (#1007)

2022-05-20 20:19:58 +08:00

const.py

[Tensor] init ColoParameter (#914)

2022-05-06 12:57:14 +08:00

dist_spec_mgr.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00

distspec.py

[Tensor] add module check and bert test (#1031)

2022-05-26 18:15:42 +08:00

op_wrapper.py

[tensor] refactor colo-tensor (#992)

2022-05-19 12:44:59 +08:00

param_op_hook.py

[tensor] ColoTensor supports ZeRo (#1015)

2022-05-31 12:00:12 +08:00

spec.py

[tensor] refactor parallel action (#1007)

2022-05-20 20:19:58 +08:00

utils.py

reorgnize colotensor directory (#1062)

2022-06-03 18:04:22 +08:00