github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-10-09 08:34:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
moe_sp
ColossalAI/examples/language/gpt/experiments/auto_parallel/saved_solution
History
YuliangLiu0306 2731531bc2 [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 
* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost
2023-01-11 14:03:49 +08:00
..
solution_1_layers.pt
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
2023-01-11 14:03:49 +08:00
solution_4_layers.pt
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
2023-01-11 14:03:49 +08:00
solution_12_layers.pt
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
2023-01-11 14:03:49 +08:00