The Implementation of Activation Function of CNN Based on FPGA Using Single Precision Floating-Point-Unit

LI Shi-hao; YING San-cong

Chinese

您当前的位置：

首页 >

文章列表页 >

The Implementation of Activation Function of CNN Based on FPGA Using Single Precision Floating-Point-Unit

更新时间：2026-09-04

- The Implementation of Activation Function of CNN Based on FPGA Using Single Precision Floating-Point-Unit
- Vol. 34, Issue 10, Pages: 105-109(2017)
- 作者机构：
  
  四川大学计算机学院视觉合成图形图像技术国家重点学科实验室机构,四川,成都,610065
- 作者简介：
- 基金信息：
- DOI：
  CLC：
- Published：2017
- 稿件说明：
移动端阅览
李施豪, 应三丛. 基于FPGA的卷积神经网络浮点激励函数实现[J]. 微电子学与计算机, 2017, 34(10): 105-109.

LI Shi-hao, YING San-cong. The Implementation of Activation Function of CNN Based on FPGA Using Single Precision Floating-Point-Unit[J]. 2017, 34(10): 105-109.
李施豪, 应三丛. 基于FPGA的卷积神经网络浮点激励函数实现[J]. 微电子学与计算机, 2017, 34(10): 105-109. DOI：

LI Shi-hao, YING San-cong. The Implementation of Activation Function of CNN Based on FPGA Using Single Precision Floating-Point-Unit[J]. 2017, 34(10): 105-109. DOI：

摘要

卷积神经网络因深度学习概念的提出再一次被研究人员所重视.激励函数是卷积神经网络的一个重要组成部分

选取了sigmoid函数作为实验对象.讨论了当前几种可行的逼近方法

最终采用分段四阶多项式拟合sigmoid函数.在FPGA上使用Verilog硬件描述语言设计了并行电路

并采集了数据集进行FPGA与CPU版本caffe库进行运算效率对比.实验结果表明

此种方法误差小效率高

FPGA在深度学习领域有着广阔的应用前景.

Abstract

Convolutional Neural Network (CNN) was gotten attention because of the presentation of Deep-Learning. It has large research value for Deep-Learning in using FPGAs. The activation function is the most necessary part of CNN. In this paper

Sigmoid function was chosen as the experiment object. The approximation ways of Sigmoid Function were listed and analysed

the piecewise forth-order approximation was the best way to fit Sigmoid Function. Parallel calculation circuit was designed by Verilog HDL on FPGAs

collecting dataset and inputing them to FPGA Platform and CPU Platform. The experiment result set forth that this solution had high efficiency and low error with rosy prospect about Deep-Learning and FPGA.

关键词

Keywords

references

Djalal Eddine, Khodja Stéphane Simard. Implementation of optimized approximate sigmoid Function on FPGA circuit to use in ANN for control and monitoring[J]. CONTROL ENGINEERING AND APPLIED INFORMATICS, 2015, 17(2): 64-72. DOI: 64

Li Bingzhe, Hassan Najafi M, David J Lilja. Using stochastic computing to reduce the hardware requirements for a restricted boltzmann machine classifier[C]// The 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. Monterey, California, USA, 2016: 36-41.

Vishnu P Nambiar, Mohamed Khalil-Hani, Riadh Sahnoun, et al. Hardware implementation of evolvable block-based neural networks utilizing a cost efficient sigmoid-like activation function[J]. Neurocomputing, 2014(140): 228-241. DOI: 228

LeCun Yann, Yoshua Bengio, Geoffrey Hinton. Deep learning[J]. Nature, 2015, 521(7553): 436-444. DOI: 436

EMMANUEL ADETIBA, IBIKUNLE F A, DARAMOLA S A, et al. Implementation of efficient multilayer perceptron ANN neurons on field programmable gate array chip[J]. International Journal of Engineering % Technology IJET-IJENS, 2014, 14(1): 151-159. DOI: 151

Jia Yangqing, Evan Shelhamer, Jeff Donahue, et al. Caffe: Convolutional architecture for fast feature embedding[C]// Proceedings of the 22nd ACM international conference on Multimedia. ACM, 2014.

Manish Panicker, BabuC. Efficient FPGA implementation of sigmoid and bipolar sigmoid activation functions for multilayer perceptrons[J]. IOSR Journal of Engineering, 2012, 2(6): 1352-1356. DOI: 1352

Sahil Abrol, Rita Mahajan. Implementation of single artificial neuron using various activation functions and XOR gate on FPGA chip[C]//IEEE: 2015 Second International Conference on Advances in Computing and Communication Engineering. IEEE, 2015: 118-123.

李彦冬, 郝宗波, 雷航. 卷积神经网络研究综述[J]. 计算机应用, 2016, 36(9): 2508-2515. DOI: 2508

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Hardware implementation of a convolutional neural network for mobile terminal based on FPGA

FPGA Implementation of Convolutional Neural Network in Speech Recognition

Simulation on the DC characteristics of double heterojunction p-GaN HEMT with AlN/GaN hybrid buffer layer

Steganography model guided by attention mechanism and improved dense convolution

Aerial vehicle detection algorithm based on multi-scale fusion and small-object enhancement

Related Author

LI Bing-chen

HUANG Lu

QU Jia-li

HE Guang-hui

WANG Guo-xing

Related Institution

School of Microelectronics, University of Science and Technology of China

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University

AI问答

Postal code：100079
Tel：（010）53879206 Email：tmw@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09082226号-64 京公网安备11010602201714号
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰