合肥工业大学 微电子设计研究所,安徽,合肥,230009
纸质出版:2021
移动端阅览
杜高明, 陈邦溢, 王晓蕾, 李桢旻. 基于分时重用行卷积查找表的BNN加速器[J]. 微电子学与计算机, 2021, 38(9): 84-92.
DU Gaoming, CHEN Bangyi, WANG Xiaolei, et al. A BNN accelerator based on time-sharing reuse row convolution LUT[J]. 2021, 38(9): 84-92.
二值化神经网络(Binary Neural Network
BNN)具有单比特数据位宽的特点,可以很好地解决传统卷积神经网络中存在大量数据量以及计算量的问题.为了进一步加速BNN的正向推导并降低所需功耗,提出一种基于FPGA的完全二值化卷积神经网络加速器,其中输入图片以及边缘填充都进行了二值化处理,并且通过分时重用行卷积查找表的方式跳过其中的冗余计算.在Xilinx的ZCU102 FPGA开发板上对所设计的加速器进行评估,结果表明加速器的运算速度可以达到3.1 TOP/s,并且可以达到144.2 GOPS/KLUT的资源效率转换比以及3 507.8 GOPS/W的能效转换比.
The single-bit data width characteristic of Binary Neural Network (BNN) can tackle large-scale-data and huge-amount-calculation in Convolution Neural Network (CNN). In order to further accelerate the forward inference of BNN and reduce the required power consumption
a fully binarized neural network accelerator based on FPGA is proposed
in which the input image and edge padding are all binarized. And the accelerator skips the redundant calculations by reusing the Row Convolution LUT (RC-LUT) in a time-sharing way. By implementing on Xilinxs ZCU102 FPGA
this accelerator can achieve a Performance of more than 3.1 TOP/s
an Area Efficiency of 144.2 GOPS/KLUT
and a Power Efficiency of 3 507.8 GOPS/W.
GENG T, WANG T Q, WU C S, et al. LP-BNN: ultra-low-latency BNN inference with layer parallelism[C]//Proceedings of the 30th International Conference on Application-Specific Systems, Architectures and Processors. New York, USA: IEEE, 2019: 9-16. DOI: 10.1109/ASAP.2019.00-43.
LIANG S, YIN S Y, LIU L B, et al. FP-BNN: binarized neural network on FPGA[J]. Neurocomputing, 2018, 275: 1072-1086. DOI: 10.1016/j.neucom.2017.09.046.
GUO P, MA H, CHEN R Z, et al. FBNA: a fully binarized neural network accelerator[C]//Proceedings of the 28th International Conference on Field Programmable Logic and Applications. Dublin, Ireland: IEEE, 2018: 51-513. DOI: 10.1109/FPL.2018.00016.
WANG J, JIN X, WU W. TB-DNN: a thin binarized deep neural network with high accuracy[C]//Proceedings of the 22nd International Conference on Advanced Communication Technology. Phoenix Park, Korea: IEEE, 2020: 419-424. DOI: 10.23919/ICACT48636.2020.9061291.
ZHAO R, SONG W N, ZHANG W T, et al. Accelerating binarized convolutional neural networks with software-programmable FPGAs[C]//Proceedings of 2017 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. Monterey, California, USA: ACM, 2017: 15-24. DOI: 10.1145/3020078.3021741.
UMUROGLU Y, FRASER N J, GAMBARDELLA G, et al. FINN: a framework for fast, scalable binarized neural network inference[C]//Proceedings of the ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. Monterey, California, USA: ACM, 2017: 65-74. DOI: 10.1145/3020078.3021744.
LIU H, LIU L B, ZHU W P, et al. L-MPC: a LUT based multi-level prediction-correction architecture for accelerating binary-weight hourglass network[C]//Proceedings of the 56th Annual Design Automation Conference 2019. Las Vegas, USA: ACM, 2019: 1-6. DOI: 10.1145/3316781.3317854.
DUAN Y Z, LI S, ZHANG R P, et al. Energy-efficient architecture for FPGA-based deep convolutional neural networks with binary weights[C]//Proceedings of the 23rd International Conference on Digital Signal Processing. Shanghai, China: IEEE, 2018: 1-5. DOI: 10.1109/ICDSP.2018.8631596.
COURBARIAUX M, BENGIO Y, DAVID J P. BinaryConnect: training deep neural networks with binary weights during propagations[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal, Canada: MIT Press, 2015: 3123-3131.
SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[J]. arXiv preprint arXiv: 1409.1556, 2015.
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[J]. Advances in Neural Information Processing Systems, 2012, 25(2): 1097-1105. DOI: 1097
COURBARIAUX M, HUBARA I, SOUDRY D, et al. Binarized neural networks: training deep neural networks with weights and activations constrained to +1 or -1[J]. arXiv preprint arXiv: 1602.02830, 2016.
0
浏览量
21
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010602201714号