oahzxl
|
212b5b1b5f
|
add comments
|
2023-01-09 16:29:33 +08:00 |
|
oahzxl
|
aafc3516a5
|
add available
|
2023-01-09 15:32:19 +08:00 |
|
oahzxl
|
d5c4f0bf95
|
code style
|
2023-01-09 15:22:09 +08:00 |
|
oahzxl
|
d106b271f8
|
add chunk search test
|
2023-01-09 15:19:08 +08:00 |
|
oahzxl
|
a005965d2d
|
update codegen test
|
2023-01-09 14:57:47 +08:00 |
|
oahzxl
|
3abbaf8bc6
|
update codegen test
|
2023-01-09 14:53:04 +08:00 |
|
oahzxl
|
74b81395a2
|
update codegen test
|
2023-01-09 14:26:22 +08:00 |
|
oahzxl
|
18a51c87fe
|
rename test
|
2023-01-09 14:20:54 +08:00 |
|
oahzxl
|
cb68ee864a
|
set benchmark
|
2023-01-09 14:20:41 +08:00 |
|
Jiarui Fang
|
4e96039649
|
[device] find best logical mesh
|
2023-01-07 14:04:30 +08:00 |
|
Frank Lee
|
40d376c566
|
[setup] support pre-build and jit-build of cuda kernels (#2374)
* [setup] support pre-build and jit-build of cuda kernels
* polish code
* polish code
* polish code
* polish code
* polish code
* polish code
|
2023-01-06 20:50:26 +08:00 |
|
oahzxl
|
a6cdbf9161
|
seperate trace flow
|
2023-01-06 17:24:23 +08:00 |
|
oahzxl
|
da4076846d
|
rename
|
2023-01-06 17:09:37 +08:00 |
|
oahzxl
|
fd87d78a28
|
rename ambiguous variable
|
2023-01-06 14:28:04 +08:00 |
|
oahzxl
|
8a634af2f5
|
close mem and code print
|
2023-01-06 14:19:45 +08:00 |
|
oahzxl
|
1a6d2a740b
|
take apart chunk code gen
|
2023-01-06 14:14:45 +08:00 |
|
HELSON
|
48d33b1b17
|
[gemini] add get static torch model (#2356)
|
2023-01-06 13:41:19 +08:00 |
|
oahzxl
|
d1f0773182
|
rename
|
2023-01-06 11:48:33 +08:00 |
|
oahzxl
|
06a5355d98
|
update test
|
2023-01-06 11:44:01 +08:00 |
|
oahzxl
|
efb1c64c30
|
restruct dir
|
2023-01-06 11:39:26 +08:00 |
|
YuliangLiu0306
|
b5a3a4a65f
|
[device] find best logical mesh
|
2023-01-05 17:21:29 +08:00 |
|
YuliangLiu0306
|
9c9246c0d9
|
[device] alpha beta profiler (#2311)
* [device] alpha beta profiler
* add usage
* fix variable name
|
2023-01-05 16:39:55 +08:00 |
|
Jiarui Fang
|
db6eea3583
|
[builder] reconfig op_builder for pypi install (#2314)
|
2023-01-04 16:32:32 +08:00 |
|
HELSON
|
5d3a2be3af
|
[amp] add gradient clipping for unit tests (#2283)
* [amp] add gradient clipping in unit tests
* fix bugs
|
2023-01-04 11:59:56 +08:00 |
|
zbian
|
e94c79f15b
|
improved allgather & reducescatter for 3d
|
2023-01-03 17:46:08 +08:00 |
|
YuliangLiu0306
|
fb87322773
|
[autoparallel] fix spelling error (#2270)
|
2023-01-03 16:13:00 +08:00 |
|
YuliangLiu0306
|
8897b8f753
|
[autoparallel] autoparallel initialize (#2238)
|
2022-12-31 01:02:14 +08:00 |
|
YuliangLiu0306
|
3b1b91eaf4
|
[autoparallel] record parameter attribute in colotracer (#2217)
* [autoparallel] record parameter attribute in collotracer
* [autoparallel] fix construct_meta_info bug
|
2022-12-28 19:29:08 +08:00 |
|
Boyuan Yao
|
24246f7aa5
|
[autoparallel] Attach input, buffer and output tensor to MetaInfo class (#2162)
* [fx] metainfo class for auto parallel
* [fx] add unit test for linear metainfo
* [fx] fix bwd param for linear
* [fx] modify unit test
* [fx] modify unit test
* [fx] modify import
* [fx] modify import
* [fx] modify import
* [fx] move meta profiler to auto parallel
* [fx] add conv metainfo class
* [fx] restore profiler
* [fx] restore meta profiler
* [autoparallel] modify unit test
* [fx] modify unit test
* [autoparallel] add batchnorm metainfo class
* [autoparallel] fix batchnorm unit test function declaration
* [fx] restore profiler
* [fx] add relu metainfo class
* [fx] restore profiler
* [autoparallel] modify metainfo input
* [autoparallel] add pooling metainfo
* [autoparallel] add F.linear metainfo generator
* [autoparallel] add binary elementwise metainfo
* [fx] recover profiler
* [autoparallel] fix forward memory calculation
* [autoparallel] modify constants.py
* [autoparallel] remove redundant print
* [autoparallel] add F.conv metainfo
* [autoparallel] linear fix
* [autoparallel] memory estimation for communication actions
* [autoparallel] fix docstring
* [autoparallel] fix variables name
* [autoparallel] attach tensor to metainfo class
* [autoparallel] fix dangerous try except
* [autoparallel] attach memory cost to shape consistency node
* [autoparallel] attach shape consistency node's metainfo to the node
* [autoparallel] remove todo in shape consistency memory estimation
* [autoparallel] fix the annotation
|
2022-12-28 13:37:40 +08:00 |
|
YuliangLiu0306
|
78509124d3
|
[autoparallel] update getitem handler (#2207)
|
2022-12-27 19:58:32 +08:00 |
|
YuliangLiu0306
|
4851f2d607
|
[autoparallel] update_getattr_handler (#2193)
|
2022-12-26 21:57:39 +08:00 |
|
YuliangLiu0306
|
f10ce01e31
|
[autoparallel] add gpt2 performance test code (#2194)
|
2022-12-26 21:56:58 +08:00 |
|
HELSON
|
a3100bd50d
|
[testing] add beit model for unit testings (#2196)
* [testing] add beit model
* [beit] fix bugs
* [beit] fix bugs
* [testing] fix bugs
|
2022-12-26 17:35:36 +08:00 |
|
HELSON
|
2458659919
|
[zero] fix error for BEiT models (#2169)
* [zero] fix error for BEiT models
* [ColoParameter] add unpack operation for tuple arguments
* fix bugs
* fix chunkv2 unit testing
* add assertion for gradient state
|
2022-12-26 15:03:54 +08:00 |
|
Jiarui Fang
|
355ffb386e
|
[builder] unified cpu_optim fused_optim inferface (#2190)
|
2022-12-23 20:57:41 +08:00 |
|
Jiarui Fang
|
9587b080ba
|
[builder] use runtime builder for fused_optim (#2189)
|
2022-12-23 17:07:03 +08:00 |
|
Jiarui Fang
|
bc0e271e71
|
[buider] use builder() for cpu adam and fused optim in setup.py (#2187)
|
2022-12-23 16:05:13 +08:00 |
|
Jiarui Fang
|
d42afd30f8
|
[builder] runtime adam and fused_optim builder (#2184)
|
2022-12-23 14:14:21 +08:00 |
|
YuliangLiu0306
|
550f8f8905
|
[autoparallel] integrate_gpt_related_tests (#2134)
* [autoparallel] integrate_gpt_related_tests
* polish code
* polish code
* add GPT2Model into runtime test
|
2022-12-23 12:36:59 +08:00 |
|
Jiarui Fang
|
27327a4c90
|
[example] add palm pytorch version (#2172)
|
2022-12-22 10:15:34 +08:00 |
|
Jiarui Fang
|
b87496a66b
|
[hotfix] fix auto policy of test_sharded_optim_v2 (#2157)
|
2022-12-20 23:03:18 +08:00 |
|
YuliangLiu0306
|
16335cb537
|
[hotfix] fix aten default bug (#2158)
|
2022-12-20 22:40:46 +08:00 |
|
Jiarui Fang
|
2827f41898
|
[Gemini] GeminiDPP convert to PyTorch Module. (#2151)
|
2022-12-20 10:19:36 +08:00 |
|
アマデウス
|
077a66dd81
|
updated attention kernel (#2133)
|
2022-12-16 10:54:03 +08:00 |
|
YuliangLiu0306
|
536560ccc0
|
[autoparallel] implement softmax handler (#2132)
|
2022-12-14 16:09:53 +08:00 |
|
Jiarui Fang
|
c89c66a858
|
[Gemini] update API of the chunkmemstatscollector. (#2129)
|
2022-12-14 00:47:06 +08:00 |
|
Jiarui Fang
|
2938edf446
|
[Gemini] update the non model data record method in runtime memory tracer (#2128)
|
2022-12-13 17:11:31 +08:00 |
|
Jiarui Fang
|
deee317b0f
|
[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127)
|
2022-12-13 16:34:10 +08:00 |
|
Jiarui Fang
|
8fac837679
|
[Gemini] update non model data calculation method (#2126)
|
2022-12-13 15:44:07 +08:00 |
|
Jiarui Fang
|
5efda69735
|
[Gemini] hotfix the unittest bugs (#2125)
|
2022-12-13 14:14:55 +08:00 |
|