24 Commits

Author	SHA1	Message	Date
duanjunwen	2f09c374f3	[feat] add memory assertation;	2024-09-04 06:34:18 +00:00
duanjunwen	e6e1a97a6d	[fix] fix requir grad position and detach position and input&output local buffer append position;	2024-09-04 03:31:08 +00:00
duanjunwen	4c1f81c683	[fix] fix bwd step if condition; remove useless comments and format info;	2024-09-03 08:56:08 +00:00
duanjunwen	ab643c9af7	[fix] rm output.data after send fwd;	2024-09-03 14:12:17 +08:00
duanjunwen	591a13bf7e	[fix] fix optim bwd;	2024-09-02 11:19:42 +00:00
duanjunwen	77fe44286c	[fix] rm zbv in hybridplugin	2024-09-02 10:00:43 +00:00
duanjunwen	6d18d38d5c	[feat] update test; rm comments;	2024-09-02 09:50:47 +00:00
duanjunwen	6af81d8c0d	[feat] add fwd_bwd_step, run_fwd_only;	2024-08-30 02:47:52 +00:00
duanjunwen	48ba22dbfd	[feat] fix optimizer bwd b & w; support return accum loss & output	2024-08-29 08:54:45 +00:00
duanjunwen	4c4b01b859	[feat] add optim backward_b_by_grad	2024-08-29 03:16:59 +00:00
duanjunwen	b1419ef76a	[fix] fix poc test; add comments in poc;	2024-08-28 05:47:53 +00:00
duanjunwen	582ba0d6ff	[feat] fix func name & ci; add comments;	2024-08-28 03:40:50 +00:00
duanjunwen	d6e3d7d2a3	[feat] fix ci; add assert;	2024-08-28 02:41:05 +00:00
duanjunwen	29383b2de0	[fix] update	2024-08-28 02:33:42 +00:00
duanjunwen	fe209164f1	[feat] add apply v_schedule graph; p & p.grad assert err exist;	2024-08-27 10:29:39 +00:00
duanjunwen	8b37323f16	[feat] add run_fwd_bwd_with_microbatch (replace input) & test; add p&p.grad assert close test & all pass;	2024-08-27 09:31:38 +00:00
duanjunwen	9e0bd1af00	[fix] fix ci test; add pytest;	2024-08-27 08:00:23 +00:00
duanjunwen	283c9ff5d2	[fix] rm useless assign and comments;	2024-08-27 07:31:58 +00:00
duanjunwen	f1c1a87246	[feat] add test for p & p grad;	2024-08-27 06:37:26 +00:00
duanjunwen	5e09c8b4e1	[feat] split communication and calculation; fix pop empty send_bwd_buffer error;	2024-08-27 06:29:13 +00:00
duanjunwen	1d75045c37	[feat] add test run_fwd_bwd automatic scheduling;	2024-08-26 11:21:56 +00:00
duanjunwen	203033ea16	[fix] fix weight not close;	2024-08-23 08:57:27 +00:00
duanjunwen	c18ef060cf	[feat] add dw test;	2024-08-23 06:04:12 +00:00
duanjunwen	ee9baedadf	[feat] add zerobubble pp (just a frame now); add POC test for dx_dw; add test for zerobubble;	2024-08-22 10:25:34 +00:00