Fully Convolutional Neural Networks (FCN) have been applied in various domains of deep learning in recent years. It can be used not only for simple image classification tasks but also for such as object detection
semantic/image segmentation and generative tasks based on Generative Adversarial Networks (GAN). Typical FCN includes not only traditional convolutional layers but also deconvolutional layers
which are computationally intensive. Most researchers are now focusing on the design optimization of the convolutional layer
but deconvolutional layer receives less attention. This paper proposes a Fully Convolutional Neural Networks accelerator using bi-direction systolic data flow
which can efficiently process the general convolution layer and deconvolution layer simultaneously. Several representative FCN models
such as DCGAN
Cascaded-FCN
etc.
have been selected in the experiment. Compared with the traditional unoptimized acceleration scheme
the proposed approach can achieve 2.8X speed up on average
and the energy consumption is reduced by 46.3%.
关键词
Keywords
references
CHEN T, DU Z, SUN N, et al. Diannao: A small-footprint high-throughput accelerator for ubiquitous machine-learning[J]. ACM Sigplan Notices, 2014, 49(4): 269-284. DOI: 269
LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition. Boston, Massachusetts, 2015: 3431-3440.
LECUN Y, BENGIO Y. Convolutional networks for images, speech, and time series[J]. The handbook of brain theory and neural networks, 1995, 3361(10): 1995. DOI: 1995
BROMBERGER M, BASTIAN P, BERGEEST J P, et al. FPGA-accelerated Richardson-Lucy deconvolution for 3D image data[C]//2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI). Prague, Czech Republic, 2016: 132-135.
ZEILER M D, KRISHNAN D, TAYLOR G W, et al. Deconvolutional networks[C]// 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010.
WEI X, YU C H, ZHANG P, et al. Automated systolic array architecture synthesis for high throughput CNN inference on FPGAs[C]//Proceedings of the 54th Annual Design Automation Conference.Austin, TX, USA, 2017: 29.
ZHANG X, DAS S, NEOPANE O, et al. A Design Methodology for Efficient Implementation of Deconvolutional Neural Networks on an FPGA[J]. arXiv preprint arXiv: 1705.02583, 2017.
RADFORD A, METZ L, CHINTALA S. Unsupervised representation learning with deep convolutional generative adversarial networks[J]. arXiv preprint arXiv: 1511.06434, 2015.