Stochastic Computing(SC) is a new technology that encodes numerical value by probability
which can effectively reduce the power consumption and area of the circuit. However
the loss of calculation accuracy caused by its inherent random characteristics limits its application. In order to improve the accuracy of Stochastic Computing
a high-precision Stochastic Computing addition unit based on error compensation principle is proposed
and a SC-MAX element is designed to calculate the maximum value of SC sequence. The simulation results show that
compared with the similar design
the calculation accuracy of the two calculation units is significantly improved. The relative error of the addition unit is reduced by more than 80% under the same SC length
and the relative error of the SC-MAX calculation unit is reduced by 90% compared with the similar design
and the LUT and FF overhead is significantly reduced by more than 10%. The two kinds of calculation units are applied to neural network. The reasoning results on MNIST and CIFAR10 data sets show that the precision loss is less than 0.04%and 0.86% respectively comparedto float point results.
关键词
Keywords
references
REN A, LI Z, DING C W, et al. SC-DCNN: highly-scalable deep convolutional neural network using stochastic computing[C]//Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems. Virtual, MI, USA: Association for Computing Machinery, 2017: 405-418. DOI:10.1145/3037697.3037746.
AKHTAR R, KHANDAY F A. Stochastic computing: systems, applications, challenges and solutions[C]//2018 3rd International Conference on Communication and Electronics Systems (ICCES). Coimbatore, India: IEEE, 2018: 722-727. DOI:10.1109/CESYS.2018.8723960.
ALAGHI A, HAYES J P. Survey of stochastic computing[J]. ACM Transactions on Embedded Computing Systems, 2013, 12(2S): 92. DOI:10.1145/2465787.2465794.
KIM K, LEE J, CHOI K. Approximate de-randomizer for stochastic circuits[C]//2015 International SoC Design Conference (ISOCC). Gyeongju, Korea (South): IEEE, 2015: 123-124. DOI:10.1109/ISOCC.2015.7401667.
XIONG H F, ABU BAKAR M, HE G H. Hardware implementation of an improved stochastic computing based deep neural network using short sequence length[J]. IEEE Transactions on Circuits and Systems Ⅱ: Express Briefs, 2020, 67(11): 2667-2671. DOI:10.1109/TCSII.2020.2969691.
YU J, KIM K, LEE J, et al. Accurate and efficient stochastic computing hardware for convolutional neural networks[C]//2017 IEEE International Conference on Computer Design (ICCD). Boston, MA: IEEE, 2017: 105-112. DOI:10.1109/ICCD.2017.24.
熊海翡, 贺光辉. 基于随机计算的大规模MIMO检测算法研究与硬件实现[J]. 微电子学与计算机, 2020, 37(7): 36-41. DOI:10.19304/j.chki.issn1000-7180.2020.07.008. XIONG H F, HE G H. Design and implementation of stochastic computing based massive MIMO detector[J]. Microelectronics % Computer, 2020, 37(7): 36-41. DOI:10.19304/j.chki.issn1000-7180.2020.07.008.