Skip to content

Add EBVs #779

Open
Open
@hhhhaww

Description

@hhhhaww

If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md

Is your feature request related to a problem? Please describe.
When the number of categories becomes large, the trainable parameters in the final linear layer of a classification network often exceed those in the feature extraction layers. This issue is hoped to be resolved by modifying the classification layer.

Describe the solution you'd like
The method proposed in the CVPR 2023 paper ``Equiangular Basis Vectors" is being used to address this issue.

Describe alternatives you've considered
I would like to add a function in 'models/layers' floder and provide a network file adopting EBVs in 'models/' floder.

Additional context
EBVs can improve the top-1 accuracy in classification tasks such as ImageNet-1K. When dealing with a larger number of categories, EBVs reduce the required training parameters for the classification head. For example, with 100,000 categories, a ResNet-50 model using EBVs as the classification head requires only 1/7 of the training parameters compared to a standard ResNet-50.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions