HELSON 077a5cdde4 [zero] fix gradient clipping in hybrid parallelism (#2521) ...

* [zero] fix gradient clipping in hybrid parallelism

* [testing] change model name to avoid pytest warning

* [hotfix] fix unit testing

2023-01-29 15:09:57 +08:00

..

low_level_zero

[zero] fix gradient clipping in hybrid parallelism (#2521)

2023-01-29 15:09:57 +08:00

common.py

[moe] fix MoE bugs (#1628)

2022-09-22 13:56:30 +08:00

test_found_inf.py

Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806)

2022-04-19 14:40:02 +08:00

test_init_context.py

[testing] add beit model for unit testings (#2196)

2022-12-26 17:35:36 +08:00

test_shard_model_v2.py

[test] align model name with the file name. (#2045)

2022-11-30 15:45:26 +08:00

test_shard_param.py

[gemini] add GeminiMemoryManger (#832)

2022-04-24 13:08:48 +08:00

test_sharded_optim_state_dict.py

[colotensor] add Tensor.view op and its unit test (#1343)

2022-07-21 10:53:15 +08:00

test_sharded_optim_v2.py

[hotfix] fix auto policy of test_sharded_optim_v2 (#2157)

2022-12-20 23:03:18 +08:00

test_sharded_optim_with_sync_bn.py

[test] refactored with the new rerun decorator (#763)

2022-04-15 00:33:04 +08:00

test_state_dict.py

[hotfix] shared model returns cpu state_dict (#1328)

2022-07-15 22:11:37 +08:00

test_tensor_utils.py

[test] ignore 8 gpu test (#1080)

2022-06-08 23:14:18 +08:00

test_zero_engine.py

[refactor] moving memtracer to gemini (#801)

2022-04-19 10:13:08 +08:00