HELSON 6e51d296f0 [zero] migrate zero1&2 (#1878) ...

* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test

2022-11-11 09:26:40 +08:00

..

low_level_zero

[zero] migrate zero1&2 (#1878)

2022-11-11 09:26:40 +08:00

common.py

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

test_found_inf.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_init_context.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_mem_collector.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_shard_model_v2.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_shard_param.py

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

test_sharded_optim_state_dict.py

[colotensor] add Tensor.view op and its unit test (#1343)

2022-07-21 10:53:15 +08:00

test_sharded_optim_v2.py

[test] refactored with the new rerun decorator (#763)

2022-04-15 00:33:04 +08:00

test_sharded_optim_with_sync_bn.py

[test] refactored with the new rerun decorator (#763)

2022-04-15 00:33:04 +08:00

test_state_dict.py

[hotfix] shared model returns cpu state_dict (#1328)

2022-07-15 22:11:37 +08:00

test_tensor_utils.py

[test] ignore 8 gpu test (#1080)

2022-06-08 23:14:18 +08:00

test_zero_engine.py

[refactor] moving memtracer to gemini (#801)

2022-04-19 10:13:08 +08:00