mirror of
https://github.com/hpcaitech/ColossalAI.git
synced 2026-07-08 20:23:22 +00:00
* [autoparallel] integrate device mesh initialization into autoparallelize * add megatron solution * update gpt autoparallel examples with latest api * adapt beta value to fit the current computation cost