github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-07-13 20:39:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,820 Commits 62 Branches 51 Tags
a5dc4253c6ea5ea1d9a5529a379eb2ffdf81622b
Commit Graph

4 Commits

Author SHA1 Message Date
YuliangLiu0306
2731531bc2 [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 
* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost
 2023-01-11 14:03:49 +08:00
Ziyue Jiang
ad00894f7f polish 2023-01-06 16:03:16 +08:00
Ziyue Jiang
3a15b20421 Move GPT PP Example 2023-01-06 14:48:58 +08:00
YuliangLiu0306
8b1e0dfd80 [example] upload auto parallel gpt2 demo (#2354) 2023-01-06 11:38:38 +08:00