Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
YG256Li authored Sep 18, 2022
1 parent 0d8faed commit c6d3535
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# BCDNet

This is the implementation of our ECCV2022 paper [Towards-Accurate-Binary-Neural-Networks-via-Modeling-Contextual-Dependencies.](https://arxiv.org/abs/2209.01404)
This is the implementation of our ECCV2022 paper: [Towards-Accurate-Binary-Neural-Networks-via-Modeling-Contextual-Dependencies](https://arxiv.org/abs/2209.01404)

Existing Binary Neural Networks (BNNs) mainly operate on local convolutions with binarization function. However, such simple bit operations lack the ability of modeling contextual dependencies, which is critical for learning discriminative deep representations in vision models. In this work, we tackle this issue by presenting new designs of binary neural modules, which enables BNNs to learn effective contextual dependencies. First, we propose a binary multi-layer perceptron (MLP) block as an alternative to binary convolution blocks to directly model contextual dependencies. Both short-range and long-range feature dependencies are modeled by binary MLPs, where the former provides local inductive bias and the latter breaks limited receptive field in binary convolutions. A sparse contextual interaction is achieved with the long-short range binary MLP block. Second, we compute the contextual dynamic embeddings to determine the binarization thresholds in general binary convolutional blocks. Armed with our binary MLP blocks and improved binary convolution, we build the BNNs with explicit Contextual Dependency modeling, termed as BCDNet. On the standard ImageNet-1K classification benchmark, the BCDNet achieves 72.3\% Top-1 accuracy and outperforms leading binary methods by a large margin. In particular, the proposed BCDNet exceeds the state-of-the-art ReActNet-A by 2.9\% Top-1 accuracy with similar operations, demonstrating the effectiveness of our binary designs.

Expand Down Expand Up @@ -44,4 +44,11 @@ The performance of BCDNets on ImageNet-1K is:
journal={arXiv preprint arXiv:2209.01404},
year={2022}
} -->

```
@article{xing2022towards,
title={Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies},
author={Xing, Xingrun and Li, Yangguang and Li, Wei and Ding, Wenrui and Jiang, Yalong and Wang, Yufeng and Shao, Jing and Liu, Chunlei and Liu, Xianglong},
journal={arXiv preprint arXiv:2209.01404},
year={2022}
}
```

0 comments on commit c6d3535

Please sign in to comment.