littsk 83b52c56cd [feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837) ... * Add clip_grad_norm for hibrid_parallel_plugin * polish code * add unittests * Move tp to a higher-level optimizer interface. * bug fix * polish code		2023-10-12 11:32:37 +08:00
..
test_hybrid_parallel_grad_clip_norm	[feature] Add clip_grad_norm for hybrid_parallel_plugin (#4837)	2023-10-12 11:32:37 +08:00
test_layer	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_model	[hotfix] fix bug in sequence parallel test (#4887)	2023-10-11 19:30:41 +08:00
__init__.py	[shardformer] adapted T5 and LLaMa test to use kit (#4049)	2023-07-04 16:05:01 +08:00
test_shard_utils.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
test_with_torch_ddp.py	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00