github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2026-01-16 15:37:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
10c61de2f7ba2f58de70d24de862b6c9bb3cd3f3
ColossalAI/examples/language/gpt/experiments
History
Ziyue Jiang 400f63012e [pipeline] Add Simplified Alpa DP Partition (#2507) 
* add alpa dp split

* add alpa dp split

* use fwd+bwd instead of fwd only

---------

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>
2023-03-07 10:34:31 +08:00
..
auto_parallel
[autoparallel] integrate device mesh initialization into autoparallelize (#2393)
2023-01-11 14:03:49 +08:00
pipeline_parallel
[pipeline] Add Simplified Alpa DP Partition (#2507)
2023-03-07 10:34:31 +08:00