Aiming at the poor classification accuracy of minority classes by classifier on unbalanced data sets
an improved k-means bi-directional sampling algorithm KMBS (k-means bi-directional sampling) is proposed
and integrated learning is applied to the classification algorithm. First
the improved k-means clustering algorithm is used to divide the original data set into different clustering clusters. Secondly
oversampling of the minority and under-sampling of the majority in the cluster using the modified SMOTE algorithm in the cluster
so as to make the dataset balance. Multiple executions of this algorithm can produce multiple data sets with large differences
so multiple classifiers with large differences can be trained to improve the effect of ensemble learning. By analyzing the experimental results
this algorithm can not only improve the overall classification performance
but also improve the classification performance of a few kinds of samples.
关键词
Keywords
references
JASON V H, TAGHI K. Knowledge discovery from imbalanced and noisy data[J].Data Knowledge Engineering, 2009, 68(12):1513-1542. DOI: 1513
WEISS G M, ZADROZNY B, SAAR M. Guest editorial:special issue on utility-based data mining[J].Data Mining and Knowledge Discovery, 2008, 17(2):129-135. DOI: 129
CHAWLA N V, BOWYER K W, HALL L O.SMOTE:synthetic minority over-sampling technique[J].Journal of Artificial Intelligence Research, 2002(16):321-357. DOI: 321
NEKOOEIMEHR I, LAI-YUEN S K. Adaptive semi-unsupervised weighted oversampling(a-suwo) for imbalanced data sets[J].Expert systems with applicationa, 2016(46):405-416. DOI: 405
DOUZAS G, BACAO F, LAST F. Improving Imbalanced Learning Through a Heuristic Oversampling Method Based on K-Means and SMOTE[J]. Information Sciences, 2018, 465:S0020025518304997-. DOI: S0020025518304997
KUBAT M, HOLTE R C, MATWIN S. Machine learning for the detection of oil spills in satellite radar images[J]. Machine Learning, 1998, 30(2):195-215. DOI: 195
DOUZAS G, BACAO F.Self-Organizing Map Oversampling(SOMO) for imbalanced data set learning[J].Expert Systems with Applications, 2017(82):40-52. DOI: 40
Gu Q, Cai Z, Zhu L, et al. Data mining on imbalanced data sets[C]//Int Conf on advanced Computer Theory and Engineering.Phuket: IEEE, 2008: 1020-1024.
Cheng X F, Li J, Li X F. An imbalanced data classification algorithm based on under sampling[J].ComputerEngineering, 2011, 37(13):147-149. DOI: 147
XIAO Y, WANG H, ZHANG L, et al. Two methods of selecting Gaussian kernel parameters for one-class SVM and their application to fault detection[J]. Knowledge-Based System, 2014, 59(2): 75-84. DOI: 75
CHARTE F, RIVERA A J, JESUS M J D, et al. Addressing imbalance in multilabel classification: Measures and random resampling algorithms[J].Neurocomputing, 2015(163):3-16. DOI: 3
王璐林.面向不均衡样本的Boosting分类算法研究[D].哈尔滨: 哈尔滨工业大学, 2013.
张金伟.不平衡数据分类研究及在肿瘤识别中的应用[D].杭州: 中国计量学院, 2012.
HAN H, WANG W Y, MAO B H. Borderline-SMOTE: a new oversampling method in imbalanced data sets learning[C]// proc of Internatioinal Comference on Intelligent Computing. Hefei, China, 2005: 878-887.