The single-bit data width characteristic of Binary Neural Network (BNN) can tackle large-scale-data and huge-amount-calculation in Convolution Neural Network (CNN). In order to further accelerate the forward inference of BNN and reduce the required power consumption
a fully binarized neural network accelerator based on FPGA is proposed
in which the input image and edge padding are all binarized. And the accelerator skips the redundant calculations by reusing the Row Convolution LUT (RC-LUT) in a time-sharing way. By implementing on Xilinxs ZCU102 FPGA
this accelerator can achieve a Performance of more than 3.1 TOP/s
an Area Efficiency of 144.2 GOPS/KLUT
and a Power Efficiency of 3 507.8 GOPS/W.
关键词
Keywords
references
GENG T, WANG T Q, WU C S, et al. LP-BNN: ultra-low-latency BNN inference with layer parallelism[C]//Proceedings of the 30th International Conference on Application-Specific Systems, Architectures and Processors. New York, USA: IEEE, 2019: 9-16. DOI: 10.1109/ASAP.2019.00-43.
LIANG S, YIN S Y, LIU L B, et al. FP-BNN: binarized neural network on FPGA[J]. Neurocomputing, 2018, 275: 1072-1086. DOI: 10.1016/j.neucom.2017.09.046.
GUO P, MA H, CHEN R Z, et al. FBNA: a fully binarized neural network accelerator[C]//Proceedings of the 28th International Conference on Field Programmable Logic and Applications. Dublin, Ireland: IEEE, 2018: 51-513. DOI: 10.1109/FPL.2018.00016.
WANG J, JIN X, WU W. TB-DNN: a thin binarized deep neural network with high accuracy[C]//Proceedings of the 22nd International Conference on Advanced Communication Technology. Phoenix Park, Korea: IEEE, 2020: 419-424. DOI: 10.23919/ICACT48636.2020.9061291.
ZHAO R, SONG W N, ZHANG W T, et al. Accelerating binarized convolutional neural networks with software-programmable FPGAs[C]//Proceedings of 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. Monterey, California, USA: ACM, 2017: 15-24. DOI: 10.1145/3020078.3021741.
UMUROGLU Y, FRASER N J, GAMBARDELLA G, et al. FINN: a framework for fast, scalable binarized neural network inference[C]//Proceedings of the ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. Monterey, California, USA: ACM, 2017: 65-74. DOI: 10.1145/3020078.3021744.
LIU H, LIU L B, ZHU W P, et al. L-MPC: a LUT based multi-level prediction-correction architecture for accelerating binary-weight hourglass network[C]//Proceedings of the 56th Annual Design Automation Conference 2019. Las Vegas, USA: ACM, 2019: 1-6. DOI: 10.1145/3316781.3317854.
DUAN Y Z, LI S, ZHANG R P, et al. Energy-efficient architecture for FPGA-based deep convolutional neural networks with binary weights[C]//Proceedings of the 23rd International Conference on Digital Signal Processing. Shanghai, China: IEEE, 2018: 1-5. DOI: 10.1109/ICDSP.2018.8631596.
COURBARIAUX M, BENGIO Y, DAVID J P. BinaryConnect: training deep neural networks with binary weights during propagations[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal, Canada: MIT Press, 2015: 3123-3131.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv: 1409.1556, 2015.
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012, 25(2): 1097-1105. DOI: 1097
COURBARIAUX M, HUBARA I, SOUDRY D, et al. Binarized neural networks: training deep neural networks with weights and activations constrained to +1 or -1[J]. arXiv preprint arXiv: 1602.02830, 2016.