Hongxin Liu a39a5c66fe Merge branch 'main' into feature/shardformer

2023-09-04 23:43:13 +08:00

..

test_checkpoint

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_activation_checkpointing.py

[devops] add large-scale distributed test marker (#4452)

2023-08-16 18:56:52 +08:00

test_commons.py

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_flash_attention.py

[shardformer] update shardformer to use flash attention 2 (#4392)

2023-08-15 23:25:14 +08:00

test_memory.py

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_norm_gradient_clipping.py

[gemini] improve compatibility and add static placement policy (#4479)

2023-08-24 09:29:25 +08:00

test_zero_gradient_clippling.py

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00