You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
When the number of categories becomes large, the trainable parameters in the final linear layer of a classification network often exceed those in the feature extraction layers. This issue is hoped to be resolved by modifying the classification layer.
Describe the solution you'd like
The method proposed in the CVPR 2023 paper ``Equiangular Basis Vectors" is being used to address this issue.
Describe alternatives you've considered
I would like to add a function in 'models/layers' floder and provide a network file adopting EBVs in 'models/' floder.
Additional context
EBVs can improve the top-1 accuracy in classification tasks such as ImageNet-1K. When dealing with a larger number of categories, EBVs reduce the required training parameters for the classification head. For example, with 100,000 categories, a ResNet-50 model using EBVs as the classification head requires only 1/7 of the training parameters compared to a standard ResNet-50.
The text was updated successfully, but these errors were encountered:
Thank you for your contribution to mindcv. Please provide the readme and related config files. We will merge them as soon as possible after verification.
Thank you for your contribution to mindcv. Please provide the readme and related config files. We will merge them as soon as possible after verification.
Thank you for your review, I have added README.md and config file. Please feel free to contact me if you have any questions.
If this is your first time, please read our contributor guidelines: https://gitee.com/mindspore/mindspore/blob/master/CONTRIBUTING.md
Is your feature request related to a problem? Please describe.
When the number of categories becomes large, the trainable parameters in the final linear layer of a classification network often exceed those in the feature extraction layers. This issue is hoped to be resolved by modifying the classification layer.
Describe the solution you'd like
The method proposed in the CVPR 2023 paper ``Equiangular Basis Vectors" is being used to address this issue.
Describe alternatives you've considered
I would like to add a function in 'models/layers' floder and provide a network file adopting EBVs in 'models/' floder.
Additional context
EBVs can improve the top-1 accuracy in classification tasks such as ImageNet-1K. When dealing with a larger number of categories, EBVs reduce the required training parameters for the classification head. For example, with 100,000 categories, a ResNet-50 model using EBVs as the classification head requires only 1/7 of the training parameters compared to a standard ResNet-50.
The text was updated successfully, but these errors were encountered: