YuliangLiu0306
|
845ff4a47a
|
[autoparallel] resnet block runtime apply (#1709)
* [autoparallel] resnet block runtime apply
* seperate buffer and parameter in MemoryCost
* polish code
* add comments and todos
* fix test issue
|
2022-10-17 13:37:38 +08:00 |
|
Frank Lee
|
22a115406b
|
[autoparallel] fixed broken node handler tests (#1708)
|
2022-10-14 18:25:59 +08:00 |
|
Frank Lee
|
6c331a5a09
|
[autoparallel] refactored the autoparallel module for organization (#1706)
* [autoparallel] refactored the autoparallel module for organization
* polish code
|
2022-10-14 13:27:00 +08:00 |
|
YuliangLiu0306
|
451cd72dea
|
[autoparallel] adapt runtime passes (#1703)
* [autoparallel] adapt runtime passes v2
* polish code
|
2022-10-14 10:14:07 +08:00 |
|
Frank Lee
|
8283e95db3
|
[autoparallel] collated all deprecated files (#1700)
* [autoparallel] collated all deprecated files
* polish code
|
2022-10-13 18:24:11 +08:00 |
|
Frank Lee
|
e2355d01b9
|
[autoparallel] init new folder structure (#1696)
|
2022-10-13 14:18:55 +08:00 |
|
YuliangLiu0306
|
81f7530ee7
|
[autoparallel] adapt solver and CostGraph with new handler (#1695)
* [autoparallel] adapt solver and CostGraph with new handler
* fix test issue
|
2022-10-13 14:04:15 +08:00 |
|
YuliangLiu0306
|
42b882ef06
|
[autoparallel] add output handler and placeholder handler (#1694)
* [autoparallel] add output handler and placeholder handler
* Delete test_solver_with_resnet.py
* fix test bugs
|
2022-10-13 13:42:36 +08:00 |
|
YuliangLiu0306
|
56088e6d98
|
[autoparallel] add pooling handler (#1690)
* [autoparallel] add pooling handler
* polish code
|
2022-10-13 13:42:13 +08:00 |
|
YuliangLiu0306
|
319d654f79
|
[autoparallel] where_handler_v2 (#1688)
* where generator
* [autoparallel] where_handler_v2
|
2022-10-13 11:02:22 +08:00 |
|
Frank Lee
|
4973157ad7
|
[autoparallel] added sharding spec conversion for linear handler (#1687)
|
2022-10-12 11:16:18 +08:00 |
|
YuliangLiu0306
|
af718e83f2
|
[autoparallel] add reshape handler v2 and fix some previous bug (#1683)
|
2022-10-11 18:12:59 +08:00 |
|
YuliangLiu0306
|
6878e42248
|
[hotfix] solver bug caused by dict type comm cost (#1686)
|
2022-10-11 17:57:03 +08:00 |
|
YuliangLiu0306
|
517b63939a
|
[autoparallel] add unary element wise handler v2 (#1674)
|
2022-10-09 17:30:42 +08:00 |
|
YuliangLiu0306
|
f6c6a932b8
|
[autoparallel] add following node generator (#1673)
* [autoparallel] add following node generator
* polish code
* polish code
* update name of arguments
|
2022-10-09 14:49:18 +08:00 |
|
YuliangLiu0306
|
52fda88796
|
[autoparallel] add layer norm handler v2 (#1671)
* [autoparallel] add layer norm handler v2
* polish code
* polish code
|
2022-10-09 14:23:22 +08:00 |
|
YuliangLiu0306
|
11ec070e53
|
[hotfix]unit test (#1670)
|
2022-09-29 12:49:28 +08:00 |
|
Frank Lee
|
a60024e77a
|
[autoparallel] added utils for broadcast operation (#1665)
* [autoparallel] added utils for broadcast operation
* polish code
|
2022-09-29 11:22:29 +08:00 |
|
YuliangLiu0306
|
3f068d1409
|
[autoparallel] update CommSpec (#1667)
|
2022-09-29 11:20:59 +08:00 |
|
Frank Lee
|
247a9dbca9
|
[autoparallel] added bias comm spec to matmul strategy (#1664)
|
2022-09-29 11:08:05 +08:00 |
|
YuliangLiu0306
|
746f8f979d
|
[autoparallel] add batch norm handler v2 (#1666)
|
2022-09-29 11:02:49 +08:00 |
|
YuliangLiu0306
|
c27e701cb2
|
[autoparallel] remove no strategy nodes (#1652)
* [autoparallel] remove no strategy nodes
* fix none object iteration issue
|
2022-09-29 10:43:25 +08:00 |
|
Frank Lee
|
50f16a2850
|
[autoparallel] added compute resharding costs for node handler (#1662)
|
2022-09-28 19:55:44 +08:00 |
|
Frank Lee
|
9ec401a722
|
[autoparallel] added new strategy constructor template (#1661)
* [autoparallel] added new strategy constructor template
* polish code
|
2022-09-28 14:01:36 +08:00 |
|
Frank Lee
|
3a4d6f63a8
|
[autoparallel] added node handler for bmm (#1655)
|
2022-09-28 11:32:16 +08:00 |
|
YuliangLiu0306
|
095854477f
|
[autoparallel] add conv handler v2 (#1663)
|
2022-09-28 11:24:59 +08:00 |
|
YuliangLiu0306
|
1e7816a460
|
[autoparallel] adapt solver with gpt (#1653)
|
2022-09-28 11:17:26 +08:00 |
|
Frank Lee
|
30e50c8b4a
|
[autoparallel] implemented all matmul strategy generator (#1650)
|
2022-09-27 12:06:25 +08:00 |
|
YuliangLiu0306
|
03978aad45
|
[autoparallel] change the following nodes strategies generation logic (#1636)
* [autoparallel] change the following nodes strategies generation logic
* fix unit test
|
2022-09-27 11:20:52 +08:00 |
|
YuliangLiu0306
|
59f100510a
|
[autoparallel] where handler (#1651)
* [autoparallel] where handler
* fix unit test
|
2022-09-27 11:20:43 +08:00 |
|
Frank Lee
|
45b39a692a
|
[autoparallel] implemented linear projection strategy generator (#1639)
|
2022-09-26 16:58:14 +08:00 |
|
YuliangLiu0306
|
b2b2a4af98
|
[autoparallel] adapt solver with mlp (#1638)
|
2022-09-26 15:26:14 +08:00 |
|
YuliangLiu0306
|
702dbc5288
|
[tensor] use communication autograd func (#1617)
* [tensor] use communication autograd func
* change all to all comm spec info
* rename pattern and distinguish fwd/bwd
* polish code
|
2022-09-23 13:31:15 +08:00 |
|
YuliangLiu0306
|
c7ac0f4ab2
|
[autoparallel] add elementwise handler (#1622)
* [autoparallel] add elementwise handler
* polish code
* polish code
* reduce skipped strategies range
* polish code
|
2022-09-23 13:27:31 +08:00 |
|
YuliangLiu0306
|
3a46215135
|
[autoparallel] add embedding handler (#1620)
|
2022-09-23 12:34:30 +08:00 |
|
YuliangLiu0306
|
69448f64c4
|
[autoparallel] protect bcast handler from invalid strategies (#1631)
|
2022-09-23 12:12:49 +08:00 |
|
YuliangLiu0306
|
0c703189b9
|
[autoparallel] add layernorm handler (#1629)
|
2022-09-23 12:00:25 +08:00 |
|
YuliangLiu0306
|
bf77d3ab65
|
[autoparallel] recover the merged node strategy index (#1613)
|
2022-09-23 11:52:42 +08:00 |
|
Frank Lee
|
d925122020
|
[autoparallel] added new linear module handler (#1616)
|
2022-09-21 12:23:21 +08:00 |
|
YuliangLiu0306
|
6a8f8cc05e
|
[hotfix] got sliced types (#1614)
|
2022-09-20 14:32:42 +08:00 |
|
Frank Lee
|
d397842fa8
|
[autoparallel] added new node handler (#1612)
|
2022-09-20 14:17:21 +08:00 |
|
YuliangLiu0306
|
7d1bb71d5d
|
[fx] PoC of runtime shape consistency application (#1607)
* [fx] PoC of runtime shape consistency application
* polish code
|
2022-09-20 14:00:04 +08:00 |
|
YuliangLiu0306
|
47b11c432c
|
[autoparallel]add bcast matmul strategies (#1605)
|
2022-09-20 11:26:21 +08:00 |
|
Frank Lee
|
edb67cb378
|
[autoparallel] refactored the data structure for sharding strategy (#1610)
|
2022-09-20 11:20:54 +08:00 |
|
YuliangLiu0306
|
eac1b79371
|
[autoparallel] add bcast op handler (#1600)
* [autoparallel] add bcast op handler
* polish code
* add more BCAST FUNC OP
* polish code
* add exception handler
* polish
|
2022-09-16 11:33:01 +08:00 |
|
Frank Lee
|
3abf98a633
|
[autoparallel] added all non-bcast matmul strategies (#1603)
|
2022-09-16 10:47:32 +08:00 |
|
Frank Lee
|
db98b695b2
|
[autoparallel] added strategy generator and bmm strategies (#1602)
|
2022-09-15 16:57:07 +08:00 |
|
YuliangLiu0306
|
faa23b9d9a
|
[autoparallel] add reshape handler (#1594)
* [autoparallel] add reshape handler
* polish code
|
2022-09-14 10:25:45 +08:00 |
|
Frank Lee
|
27fe8af60c
|
[autoparallel] refactored shape consistency to remove redundancy (#1591)
* [autoparallel] refactored shape consistency to remove redundancy
* polish code
* polish code
* polish code
|
2022-09-13 18:30:18 +08:00 |
|
YuliangLiu0306
|
d164449d00
|
[autoparallel] add resnet autoparallel unit test and add backward weight communication cost (#1589)
|
2022-09-13 18:05:05 +08:00 |
|