duanjunwen
|
4c4b01b859
|
[feat] add optim backward_b_by_grad
|
2024-08-29 03:16:59 +00:00 |
|
duanjunwen
|
8b37323f16
|
[feat] add run_fwd_bwd_with_microbatch (replace input) & test; add p&p.grad assert close test & all pass;
|
2024-08-27 09:31:38 +00:00 |
|
duanjunwen
|
9e0bd1af00
|
[fix] fix ci test; add pytest;
|
2024-08-27 08:00:23 +00:00 |
|
duanjunwen
|
283c9ff5d2
|
[fix] rm useless assign and comments;
|
2024-08-27 07:31:58 +00:00 |
|
duanjunwen
|
1b4bb2beeb
|
[feat] add comments for ZBV func;
|
2024-08-27 07:11:50 +00:00 |
|
duanjunwen
|
5e09c8b4e1
|
[feat] split communication and calculation; fix pop empty send_bwd_buffer error;
|
2024-08-27 06:29:13 +00:00 |
|
duanjunwen
|
1d75045c37
|
[feat] add test run_fwd_bwd automatic scheduling;
|
2024-08-26 11:21:56 +00:00 |
|
duanjunwen
|
c18ef060cf
|
[feat] add dw test;
|
2024-08-23 06:04:12 +00:00 |
|
duanjunwen
|
ee9baedadf
|
[feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble;
|
2024-08-22 10:25:34 +00:00 |
|