Aiming at the deficiency that model high level semantic motion pattern and semantic movement evolution in the research of traditional video action recognition
this paper proposes a part semantic based video action recognition method. First
it extracts high level semantic features based on the position information of the body parts. Second
we propose a feature descriptor for action recognition based on human part semantic and its movement evolution. The method is implemented on Caffe. The experiment results display good performance.
关键词
Keywords
references
Girshick R. Fast R-CNN[C]//IEEE International Conference on Computer Vision. Houston, TX, USA, 2015: 1440-1448.
Bilen H, Fernando B, Gavves E, et al. Dynamic image networks for action recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA, 2016: 3034-3042.
Kuehne H, Jhuang H, Garrote E, et al. HMDB: A large video database for human motion recognition[C]//IEEE International Conference on Computer Vision. Barcelona, Spain, 2011: 2556-2563.
Tran D, Bourdev L, Fergus R, et al. Learning spatiotemporal features with 3d convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision. Houston, TX, USA, 2015: 4489-4497.
Simonyan K, Zisserman A. Two-stream convolutional networks for action recognition in videos[C]//Advances in neural information processing systems. Montreal, Quebec, Canada, 2014: 568-576.
Wang L, Xiong Y, Wang Z, et al. Temporal segment networks: towards good practices for deep action recognition[J]. Acm Transactions on Information Systems, 2016, 22(1): 20-36. DOI: 20
Yang X, Molchanov P, Kautz J. Multilayer and multimodal fusion of deep neural networks for video classification[C]//ACM on Multimedia Conference 2016.Amsterdam, The Netherlands, 2016: 978-987.
Chu X, Ouyang W, Li H, et al. Structured feature learning for pose estimation[C]//IEEE Conference on Computer Vision and Pattern Recognition 2016. Boston, Massac, 2016: 4715-4723.
Chéron G, Laptev I, Schmid C. P-cnn: Pose-based cnn features for action recognition[C]//Proceedings of the IEEE International Conference on Computer Vision. Houston, TX, USA 2015: 3218-3226.
Zhang Bowen, Wang Limin, Wang Zhe, et al. Real-time action recognition with enhanced motion vector CNNs[C]//2016 IEEE International Conference on Computer Vision and Pattern Recognition. Boston, Massac, 2016: 2718-2726.
Fernando B, Anderson P, Hutter M, et al. Discriminative hierarchical rank pooling for activity recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, NV, USA, 2016: 1924-1932.
Su W T, Lu Y H, Kaseb A S. Harvest the information from multimedia big data in global camera networks[C]//Multimedia Big Data (BigMM), 2015 IEEE International Conference on. Beijing, China, IEEE, 2015: 184-191.