github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-09-10 05:20:33 +00:00
Code Issues Packages Projects Releases Wiki Activity

[fix] rm requir_grad for output;

Browse Source
This commit is contained in:
duanjunwen
2024-09-03 09:24:40 +00:00
parent b4103f125c
commit 20503cdfdf
1 changed files with 0 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/pipeline/schedule/zero_bubble_pp.py
View File

@@ -569,7 +569,6 @@ class ZeroBubbleVPipeScheduler(PipelineSchedule):
) )
detached_output_obj = output_obj.clone() detached_output_obj = output_obj.clone()
detached_output_obj.requires_grad_()
# Step3: send fwd # Step3: send fwd
# add output to send_fwd_buffer # add output to send_fwd_buffer