github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-20 04:32:47 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add n_fused as an input from native_module (#5894)

Browse Source
This commit is contained in:
Insu Jang 2024-07-23 11:15:39 -04:00 committed by GitHub
parent 4ec17a7cdf
commit a521ffc9f8
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/shardformer/layer/qkv_fused_linear.py
View File

@ -695,6 +695,7 @@ class FusedLinear1D_Col(ParallelModule):
process_group=process_group, process_group=process_group,
weight=module.weight, weight=module.weight,
bias_=module.bias, bias_=module.bias,
n_fused=n_fused,
*args, *args,
**kwargs, **kwargs,
) )