ver217 0c51ff2c13 [hotfix] ZeroDDP use new process group (#1333) ...

* process group supports getting ranks in group

* chunk mgr receives a process group

* update unit test

* fix unit tests

2022-07-18 14:14:52 +08:00

..

common.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_found_inf.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_init_context.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_mem_collector.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_shard_model_v2.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_shard_param.py

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

test_sharded_optim_state_dict.py

[refactor] remove gpc dependency in colotensor's _ops (#1189)

2022-07-04 18:54:37 +08:00

test_sharded_optim_v2.py

[test] refactored with the new rerun decorator (#763)

2022-04-15 00:33:04 +08:00

test_sharded_optim_with_sync_bn.py

[test] refactored with the new rerun decorator (#763)

2022-04-15 00:33:04 +08:00

test_state_dict.py

[hotfix] shared model returns cpu state_dict (#1328)

2022-07-15 22:11:37 +08:00

test_tensor_utils.py

[test] ignore 8 gpu test (#1080)

2022-06-08 23:14:18 +08:00

test_zero_engine.py

[refactor] moving memtracer to gemini (#801)

2022-04-19 10:13:08 +08:00

test_zero_optim_state_dict.py

[hotfix] ZeroDDP use new process group (#1333)

2022-07-18 14:14:52 +08:00