广东工业大学 机构 计算机学院,广东,广州,510006
纸质出版:2020
移动端阅览
柳毅, 曾昊. 改进K-means的双向采样非均衡数据分类方法[J]. 微电子学与计算机, 2020, 37(3): 60-65.
LIU Yi, ZENG Hao. Improved the bi-directional sampling unbalanced data classification method of K-means[J]. 2020, 37(3): 60-65.
针对分类器在不均衡数据集上对小类分类准确率较差的问题,提出了改进K-means的双向采样算法KMBS(k-means bi-directional sampling),并将集成学习应用在分类算法上.首先,使用改进的K-means聚类算法将原始数据集划分为不同的聚类簇.其次,在聚类簇中使用改进的SMOTE算法对小类样本过采样,对聚类簇内的大类样本欠采样,使数据集平衡.多次执行该算法可以产生多个差异较大的数据集,因此训练出多个差异较大的分类器,提升集成学习的效果.通过分析实验结果,该算法较现有几种算法不仅能提高整体分类性能,并且有效提高小类样本的分类性能.
Aiming at the poor classification accuracy of minority classes by classifier on unbalanced data sets
an improved k-means bi-directional sampling algorithm KMBS (k-means bi-directional sampling) is proposed
and integrated learning is applied to the classification algorithm. First
the improved k-means clustering algorithm is used to divide the original data set into different clustering clusters. Secondly
oversampling of the minority and under-sampling of the majority in the cluster using the modified SMOTE algorithm in the cluster
so as to make the dataset balance. Multiple executions of this algorithm can produce multiple data sets with large differences
so multiple classifiers with large differences can be trained to improve the effect of ensemble learning. By analyzing the experimental results
this algorithm can not only improve the overall classification performance
but also improve the classification performance of a few kinds of samples.
JASON V H, TAGHI K. Knowledge discovery from imbalanced and noisy data[J].Data Knowledge Engineering, 2009, 68(12):1513-1542. DOI: 1513
WEISS G M, ZADROZNY B, SAAR M. Guest editorial:special issue on utility-based data mining[J].Data Mining and Knowledge Discovery, 2008, 17(2):129-135. DOI: 129
CHAWLA N V, BOWYER K W, HALL L O.SMOTE:synthetic minority over-sampling technique[J].Journal of Artificial Intelligence Research, 2002(16):321-357. DOI: 321
NEKOOEIMEHR I, LAI-YUEN S K. Adaptive semi-unsupervised weighted oversampling(a-suwo) for imbalanced data sets[J].Expert systems with applicationa, 2016(46):405-416. DOI: 405
DOUZAS G, BACAO F, LAST F. Improving Imbalanced Learning Through a Heuristic Oversampling Method Based on K-Means and SMOTE[J]. Information Sciences, 2018, 465:S0020025518304997-. DOI: S0020025518304997
KUBAT M, HOLTE R C, MATWIN S. Machine learning for the detection of oil spills in satellite radar images[J]. Machine Learning, 1998, 30(2):195-215. DOI: 195
DOUZAS G, BACAO F.Self-Organizing Map Oversampling(SOMO) for imbalanced data set learning[J].Expert Systems with Applications, 2017(82):40-52. DOI: 40
杨智明, 乔立岩, 彭喜元.基于改进SMOTE的不平衡数据挖掘方法研究[J].电子学报, 2007, 35(12):22-26. DOI: 22
Gu Q, Cai Z, Zhu L, et al. Data mining on imbalanced data sets[C]//Int Conf on advanced Computer Theory and Engineering.Phuket: IEEE, 2008: 1020-1024.
Cheng X F, Li J, Li X F. An imbalanced data classification algorithm based on under sampling[J].ComputerEngineering, 2011, 37(13):147-149. DOI: 147
XIAO Y, WANG H, ZHANG L, et al. Two methods of selecting Gaussian kernel parameters for one-class SVM and their application to fault detection[J]. Knowledge-Based System, 2014, 59(2): 75-84. DOI: 75
CHARTE F, RIVERA A J, JESUS M J D, et al. Addressing imbalance in multilabel classification: Measures and random resampling algorithms[J].Neurocomputing, 2015(163):3-16. DOI: 3
王璐林.面向不均衡样本的Boosting分类算法研究[D].哈尔滨: 哈尔滨工业大学, 2013.
张金伟.不平衡数据分类研究及在肿瘤识别中的应用[D].杭州: 中国计量学院, 2012.
HAN H, WANG W Y, MAO B H. Borderline-SMOTE: a new oversampling method in imbalanced data sets learning[C]// proc of Internatioinal Comference on Intelligent Computing. Hefei, China, 2005: 878-887.
0
浏览量
22
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010602201714号