Add FocalNets #83
Description
TL:DR; Attentionless networks in which:
self-attention (SA) is completely replaced by a focal modulation mechanism for modeling token interactions in vision.
Reference: https://arxiv.org/abs/2203.11926
{{ message }}
TL:DR; Attentionless networks in which:
self-attention (SA) is completely replaced by a focal modulation mechanism for modeling token interactions in vision.
Reference: https://arxiv.org/abs/2203.11926