FoolPlayer f7774ec0f3 [Shardformer] Downstream bert (#3979) ...

* add dist dropout in model

* update docstring and bert policy with dropout

* refactor basepolicy and sharded, update bert

* update format

* update gpt2 policy

* update bert policy

* remove unused code

* update readme for new policy usage

* add downstream model of bert

* remove unused code

2023-07-04 16:05:01 +08:00

..

components_to_test

[CI] fix typo with tests/ etc. (#3727)

2023-05-11 16:30:58 +08:00

kit

fix typo tests/ (#3936)

2023-06-09 09:49:41 +08:00

test_amp

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_analyzer

[devops] update torch version of CI (#3725)

2023-05-15 17:20:56 +08:00

test_auto_parallel

[gemini] fix argument naming during chunk configuration searching

2023-06-25 13:34:15 +08:00

test_autochunk

[booster] make optimizer argument optional for boost (#3993)

2023-06-15 17:38:42 +08:00

test_booster

[lazy] refactor lazy init (#3891)

2023-06-05 14:20:47 +08:00

test_checkpoint_io

[gemini] fix argument naming during chunk configuration searching

2023-06-25 13:34:15 +08:00

test_cluster

[devops] update torch version of CI (#3725)

2023-05-15 17:20:56 +08:00

test_comm

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_config

[pipeline] refactor the pipeline module (#1087)

2022-06-10 11:27:38 +08:00

test_context

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_data

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_data_pipeline_tensor_parallel

[CI] fix typo with tests/ etc. (#3727)

2023-05-11 16:30:58 +08:00

test_ddp

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_device

[format] applied code formatting on changed files in pull request 4021 (#4022)

2023-06-19 11:23:24 +08:00

test_engine

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_fx

[devops] update torch version of CI (#3725)

2023-05-15 17:20:56 +08:00

test_layers

[CI] fix typo with tests/ etc. (#3727)

2023-05-11 16:30:58 +08:00

test_lazy

Revert "[sync] sync feature/shardformer with develop"

2023-06-09 09:41:27 +08:00

test_moe

[CI] fix typo with tests/ etc. (#3727)

2023-05-11 16:30:58 +08:00

test_ops

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_optimizer

[bf16] add bf16 support (#3882)

2023-06-05 15:58:31 +08:00

test_pipeline

[test] refactor tests with spawn (#3452)

2023-04-06 14:51:35 +08:00

test_shardformer

[Shardformer] Downstream bert (#3979)

2023-07-04 16:05:01 +08:00

test_tensor

[gemini] fix argument naming during chunk configuration searching

2023-06-25 13:34:15 +08:00

test_trainer

[CI] fix typo with tests/ etc. (#3727)

2023-05-11 16:30:58 +08:00

test_utils

[lazy] refactor lazy init (#3891)

2023-06-05 14:20:47 +08:00

test_zero

[gemini] fix argument naming during chunk configuration searching

2023-06-25 13:34:15 +08:00

__init__.py

[zero] Update sharded model v2 using sharded param v2 (#323)

2022-03-11 15:50:28 +08:00