Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add bias correction #108

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Jiang-Stan
Copy link
Collaborator

@Jiang-Stan Jiang-Stan commented Dec 21, 2022

  • Backend: virtual
  • W: Symmetric
    • ResNet18: MSE Observer
    • MobilenetV2: MinMax Observer
    • DeiT: MinMax Observer
  • A: layerwise 8bit, MinMax Observer, Symmetric
  • Eval num: 5000
Model configs weight granularity top1 top5 reported top1(from Adaround paper)
ResNet18 float - 69.86 89.4
ResNet18 4w8f layerwise 20.16 40.12 23.99
ResNet18 4w8f w/ BC layerwise 38.04 62.44 38.87
ResNet18 4w8f channelwise 53.86 76.02 -
ResNet18 4w8f w/ BC channelwise 59.60 82.96 -
DeiT float - 72.76 91.12 -
DeiT 8w8f channelwise 71.52 90.76 -
DeiT 8w8f w/ BC channelwise 71.58 90.42 -
DeiT 4w8f channelwise 64.18 86.42 -
DeiT 4w8f w/ BC channelwise 64.68 86.82 -
Model configs weight qscheme feature qscheme top1 top5
MobileNetV2 float - - 72.60 90.10
MobileNetV2 8w8f per-tensor-symmetric per-tensor-symmetric 67.56 87.44
MobileNetV2 8w8f w/ BC per-tensor-symmetric per-tensor-symmetric 70.10 88.98
MobileNetV2 8w8f per-tensor-symmetric per-tensor-affine 68.86 88.46
MobileNetV2 8w8f w/ BC per-tensor-symmetric per-tensor-affine 71.32 89.96
MobileNetV2 8w8f per-channel-symmetric per-tensor-symmetric 70.50 89.50
MobileNetV2 8w8f w/ BC per-channel-symmetric per-tensor-symmetric 70.58 89.44
MobileNetV2 8w8f per-channel-symmetric per-tensor-affine 71.44 89.64
MobileNetV2 8w8f w/ BC per-channel-symmetric per-tensor-affine 72.1 89.82

@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch 2 times, most recently from 08c3ebf to 42cefff Compare December 23, 2022 06:53
@Jiang-Stan Jiang-Stan changed the title Test bias correction Add bias correction Dec 23, 2022
@Jiang-Stan Jiang-Stan requested a review from PeiqinSun December 23, 2022 06:59
@hych2020
Copy link
Collaborator

hych2020 commented Jan 3, 2023

加个mobilenetv2的bias correction结果(8w8f)

@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch from 42cefff to fd322c8 Compare January 3, 2023 08:11
add bias correction

rectify

inprogressing

resnet18 ok

resnet18 ok

deit ok

deit ok

black

rebase

black

support non-fixed input

black
@Jiang-Stan Jiang-Stan force-pushed the add_bias_correction branch from fd322c8 to e15c4a6 Compare January 3, 2023 10:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants