Its difficult to determine the structure of deep belief network (DBN)
so raise the method that use the wolves algorithm to determine the number of DBN per layer of neurons
and K-means Clustering Accuracy Determines whether or not to increase the hidden layer method. According to the minimal reconstruction error function of wolves algorithm
it can work out the quantity of each neuron
so as to determine the initial structure of the DBN. In order to verify the effectiveness of the DBN structure
using DBN to extract the data characteristics of the clustering test
so can get the final structure of the DBN. The Iris dataset was tested in the experiment
the results show that the proposed method handles the raw data by the effective structure of the DBN obtained and improve the accuracy of clustering.
关键词
Keywords
references
Tokdar S T, Kass R E. Importance sampling: a review[J]. Wiley Interdisciplinary Reviews Computational Statistics, 2010, 2(1):54-60. DOI: 54
Oxford Benardos P G, Vosniakos G C. Optimizing feedforward artificial neural network architecture[M]. Oxford, Pergamon Press, Inc. 2007.
Gao Daqi. Research on the structure of three layer neural network of teachers with linear basic function[J]. Journal of Circuits and Systems, 1997, 21(3):31-37. DOI: 31
Beijing Wang Xue. Intelligent testing of tests[M]. Beijing: Qinghua University Press, 2008.
Cambridge, Massachusetts, United States Schölkopf B, Platt J, Hofmann T. Greedy layer-wise training of deep networks[M]. Cambridge, Massachusetts, United States, MIT Press, 2007:153-160. DOI: 153
Salakhutdinov R, Murray I. On the quantitative analysis of deep belief networks[C]// International Conference on Machine Learning. ACM, 2008: 872-879.
Hinton G E, Salakhutdinov R R. Reducing the dimensionality of data with neural networks[J]. Science, 2006, 313(5786):504-507. DOI: 504
Hinton G E. Learning multiple layers of representation.[J]. Trends in Cognitive Sciences, 2007, 11(10):428-432. DOI: 428
Liu Kai, Zhang Li-min, Sun Yongwei. RBM optimization design based on genetic algorithm[J]. Microelectronics and Computer, 2005, 35 (21) :660-662. DOI: 660
Hinton G E. A practical guide to training restricted boltzmann machines[J]. Momentum, 2012, 9(1):599-619. DOI: 599
Li Fei, Guang GaoXiao, Wan Kaifang. Research on RBM training algorithm based on dynamic gibbs sampling[J]. Acta Automatica Sinica, 2016, 42(6):931-942. DOI: 931
Bengio Y. Learning deep architectures for AI[J]. Foundations and trends in Machine Learning, 2009, 2(1):1-127. DOI: 1
Liu Liqing, Ding Qiaolin, Zhang Tiefeng. Influence of data preprocessing method on fuzzy C - means clustering[J]. Electric Power Science and Engineering, 2011, 27(8):24-27. DOI: 24
Bengio Y, Delalleau O. Justifying and generalizing contrastive divergence[J]. Neural Computation, 1989, 21(6):1601-1605. DOI: 1601
Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets[J]. Neural Computation, 1989, 18(7):1527-1554. DOI: 1527