LI Peng, JIANG Pin-qun, ZENG Shang-you, et al. Design of lightweight convolution neural network based on group residual structure[J]. 2019, 36(7): 43-47.
LI Peng, JIANG Pin-qun, ZENG Shang-you, et al. Design of lightweight convolution neural network based on group residual structure[J]. 2019, 36(7): 43-47.DOI:
Design of lightweight convolution neural network based on group residual structure
In order to solve the problem that the parameters of traditional deep convolution neural network are too large to be used in mobile devices
a lightweight convolution neural network architecture GResNets based on group residual structure is proposed. Using the bottleneck structure with three convolution layers
the output feature maps of the previous layer are divided into four equal groups. Three lightweight convolution neural network architectures are designed according to the way of adding identical mapping to the bottleneck module in the group and whether or not the adjacent module outside the group joins residual learning. In the experimental stage
the performance of the three network architectures was evaluated on three image recognition datasets
Caltech-256
Food-101 and GTSRB. The experimental results show that GResNets has the same or even better classification performance than traditional deep convolution neural networks under the condition of fewer network parameters
and is suitable for mobile devices.
关键词
Keywords
references
PANDEY P, DEEPTHI A, MANDAL B, et al. FoodNet: recognizing foods using ensemble of deep networks[J]. IEEE Signal Processing Letters, 2017, 24(12): 1758-1762. DOI: 1758
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. Imagenet classification with deep convolutional neural networks[C]//Advances in neural information processing systems. [s.l.]2012: 1097-1105.
JIA Y, SHELHAMER E, DONAHUE J, et al. Caffe: Convolutional architecture for fast feature embedding[C]//Proceedings of the 22nd ACM international conference on Multimedia. ACM, 2014: 675-678.
XIE S, GIRSHICK R, DOLLAR P, et al. Aggregated residual transformations for deep neural networks[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). USA, Honolulu, IEEE, 2017: 5987-5995.
SERMANET P, LECUN Y. Traffic sign recognition with multi-scale convolutional networks[C]//Neural Networks (IJCNN), The 2011 International Joint Conference on. USA, San Jose, IEEE, 2011: 2809-2813.
GONZALEZ-REYNA S E, AVINA-CERVANTES J G, LEDESMA-OROZCO S E, et al. Traffic sign recognition based on linear discriminant analysis[C]//Mexican International Conference on Artificial Intelligence. Springer, Berlin, Heidelberg, 2013: 185-193.
HERAVI E J, AGHDAM H H, PUIG D. An optimized convolutional neural network with bottleneck and spatial pyramid pooling layers for classification of foods[J]. Pattern Recognition Letters, 2018(105): 50-58. DOI: 50
IANDOLA F N, HAN S, MOSKEWICZ M W, et al. Squeezenet: Alexnet-level accuracy with 50x fewer parameters and < 0.5 mb model size[J]. arXiv preprint arXiv:1602.07360, 2016.
CHOLLET F. Xception: Deep learning with depthwise separable convolutions[J]. arXiv preprint arXiv: 1610.02357, 2017.
HOWARD A G, ZHU M, CHEN B, et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications[J]. arXiv preprint arXiv:1704.04861, 2017.