Jiarui Fang 3af13a2c3e [zero] polish ShardedOptimV2 unittest (#385) ...

* place params on cpu after zero init context

* polish code

* bucketzed cpu gpu tensor transter

* find a bug in sharded optim unittest

* add offload unittest for ShardedOptimV2.

* polish code and make it more robust

2022-03-11 15:50:28 +08:00

..

common.py

[unit test] Refactored test cases with component func (#339)

2022-03-11 15:50:28 +08:00

test_init_context.py

[zero] zero init context collect numel of model (#375)

2022-03-11 15:50:28 +08:00

test_shard_model_v2.py

[zero] able to place params on cpu after zero init context (#365)

2022-03-11 15:50:28 +08:00

test_shard_param.py

[unit test] Refactored test cases with component func (#339)

2022-03-11 15:50:28 +08:00

test_sharded_optim_v2_with_cpu_adam.py

[test] polish zero related unitest (#351)

2022-03-11 15:50:28 +08:00

test_sharded_optim_v2.py

[zero] polish ShardedOptimV2 unittest (#385)

2022-03-11 15:50:28 +08:00

test_sharded_optim_with_sync_bn.py

[unit test] Refactored test cases with component func (#339)

2022-03-11 15:50:28 +08:00

test_sharded_optim.py

[unit test] Refactored test cases with component func (#339)

2022-03-11 15:50:28 +08:00

test_state_dict.py

[unit test] Refactored test cases with component func (#339)

2022-03-11 15:50:28 +08:00

test_zero_param_mgr.py

using pytest parametrize

2022-03-11 15:50:28 +08:00