Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add EBVs #779

Open
bftan1949 opened this issue May 27, 2024 · 2 comments · May be fixed by #780
Open

Add EBVs #779

bftan1949 opened this issue May 27, 2024 · 2 comments · May be fixed by #780
Assignees

Comments

@bftan1949
Copy link

If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md

Is your feature request related to a problem? Please describe.
When the number of categories becomes large, the trainable parameters in the final linear layer of a classification network often exceed those in the feature extraction layers. This issue is hoped to be resolved by modifying the classification layer.

Describe the solution you'd like
The method proposed in the CVPR 2023 paper ``Equiangular Basis Vectors" is being used to address this issue.

Describe alternatives you've considered
I would like to add a function in 'models/layers' floder and provide a network file adopting EBVs in 'models/' floder.

Additional context
EBVs can improve the top-1 accuracy in classification tasks such as ImageNet-1K. When dealing with a larger number of categories, EBVs reduce the required training parameters for the classification head. For example, with 100,000 categories, a ResNet-50 model using EBVs as the classification head requires only 1/7 of the training parameters compared to a standard ResNet-50.

@bftan1949 bftan1949 linked a pull request May 27, 2024 that will close this issue
4 tasks
@IASZHT
Copy link
Collaborator

IASZHT commented Jul 24, 2024

Thank you for your contribution to mindcv. Please provide the readme and related config files. We will merge them as soon as possible after verification.

@bftan1949
Copy link
Author

Thank you for your contribution to mindcv. Please provide the readme and related config files. We will merge them as soon as possible after verification.

Thank you for your review, I have added README.md and config file. Please feel free to contact me if you have any questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants