Commit Graph

7 Commits

Author SHA1 Message Date
YuliangLiu0306
81330b0352 [autoparallel] add experimental permute handler (#2029) 2022-11-27 20:26:52 +08:00
Genghan Zhang
d655eea515 [autoparallel] mix gather (#1977)
* Add mix-gather

* Add comments

* Add comments

* Polish comments

* Change the global rank assumption

* Add tests

* Add two-step tests

* Fix 10 and 01

* Skip test becasue the number of GPUs
2022-11-23 21:49:17 +08:00
YuliangLiu0306
36c0f3ea5b [autoparallel] remove redundancy comm node (#1893) 2022-11-15 10:53:41 +08:00
YuliangLiu0306
b0f7c8bde8 [autoparallel] update CommSpec to CommActions (#1768)
* [autoparallel] update CommSpec to CommActions

* polish code
2022-10-28 09:57:43 +08:00
YuliangLiu0306
980ed21723 [autoparallel] shard param and buffer as expected (#1753)
* [autoparallel] shard param and buffer as expected

* fix unit test issue
2022-10-21 15:45:13 +08:00
YuliangLiu0306
a4ce180e85 [autoparallel] add sequential order to communication actions (#1735) 2022-10-20 18:48:18 +08:00
YuliangLiu0306
3f068d1409 [autoparallel] update CommSpec (#1667) 2022-09-29 11:20:59 +08:00