ver217 e396bb71f2 [zero] add tensor placement policies (#743) ...

* add tensor placement policies

* polish comments

* polish comments

* update moe unit tests

2022-04-13 15:00:48 +08:00

..

common.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_found_inf.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_init_context.py

[zero] refactor ShardedParamV2 for convenience (#742)

2022-04-13 14:54:26 +08:00

test_shard_model_v2.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_shard_param.py

[zero] refactor ShardedParamV2 for convenience (#742)

2022-04-13 14:54:26 +08:00

test_sharded_optim_v2.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_sharded_optim_with_sync_bn.py

[utils] correct cpu memory used and capacity in the context of multi-process (#726)

2022-04-12 14:57:54 +08:00

test_state_dict.py

[utils] correct cpu memory used and capacity in the context of multi-process (#726)

2022-04-12 14:57:54 +08:00

test_stateful_tensor_mgr.py

[zero] add tensor placement policies (#743)

2022-04-13 15:00:48 +08:00

test_tensor_utils.py

[utils] correct cpu memory used and capacity in the context of multi-process (#726)

2022-04-12 14:57:54 +08:00

test_zero_engine.py

[bug] fixed DDP compatibility with torch 1.8 (#739)

2022-04-13 00:08:46 +08:00