Skip to content

Commit e988a79

Browse files
committed
Update dependencyvit.py
1 parent 0effbce commit e988a79

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

timm/models/dependencyvit.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -105,7 +105,7 @@ def forward(self, in_tuple: Tuple[torch.Tensor, torch.Tensor]) -> Tuple[torch.Te
105105
x = attn @ v
106106

107107
# FIXME messy way to handle
108-
if self.track_dependency_mask or not isinstance(self.token_pruner, nn.Identity()):
108+
if self.track_dependency_mask or self.token_pruner:
109109
dependency_mask = attn.detach().sum(1) # [B, N, N]
110110
self.dependency_mask = dependency_mask if self.track_dependency_mask else None
111111
#FIXME how to prune

0 commit comments

Comments
 (0)