YuliangLiu0306 2731531bc2 [autoparallel] integrate device mesh initialization into autoparallelize (#2393) ...

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost

2023-01-11 14:03:49 +08:00

..

solution_1_layers.pt

…

solution_4_layers.pt

…

solution_12_layers.pt

…