github/ColossalAI
1
0
Fork 0
mirror of https://github.com/hpcaitech/ColossalAI.git synced 2025-06-22 13:41:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

add the explanation

Browse Source
This commit is contained in:
wangbluo 2025-05-14 12:50:07 +08:00
parent b032cf9b16
commit 0e9d628bb7
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
colossalai/shardformer/modeling/sam.py
View File

@ -2,6 +2,7 @@ import torch
from torch import nn from torch import nn
# Same as the SamVisionAttention forward method in the v4.51.3 transformers
def forward_fn(): def forward_fn():
def forward(self, hidden_states: torch.Tensor, output_attentions=False) -> torch.Tensor: def forward(self, hidden_states: torch.Tensor, output_attentions=False) -> torch.Tensor:
batch_size, height, width, _ = hidden_states.shape batch_size, height, width, _ = hidden_states.shape