Prediction model of disk failure based on adaptive weighted bagging-GBDT algorithm under imbalanced dataset

LI Xin-peng; GAO Xin; HE Yang; YAN Bo; SUN Han-xu; LI Jun-liang; XU Jian-hang; LIU Zhen-yu; PANG Bo

Chinese

您当前的位置：

首页 >

文章列表页 >

Prediction model of disk failure based on adaptive weighted bagging-GBDT algorithm under imbalanced dataset

更新时间：2026-09-04

- Prediction model of disk failure based on adaptive weighted bagging-GBDT algorithm under imbalanced dataset
- Vol. 37, Issue 3, Pages: 14-19(2020)
- 作者机构：
  
  1. 国家电网有限公司,北京,100031
  2. 北京邮电大学自动化学院,北京,100876
  3. 国网冀北电力有限公司,北京,100054
  4. 南瑞集团(国网电力科学研究院机构 )有限公司,北京,100192
  5. 国网冀北电力有限公司承德供电公司,河北,承德,067000
- 作者简介：
- 基金信息：
- DOI：
  CLC：
- Published：2020
- 稿件说明：
移动端阅览
李新鹏, 高欣, 何杨, 阎博, 孙汉旭, 李军良, 徐建航, 刘震宇, 庞博. 不平衡数据集下基于自适应加权Bagging-GBDT算法的磁盘故障预测模型[J]. 微电子学与计算机, 2020, 37(3): 14-19.

LI Xin-peng, GAO Xin, HE Yang, et al. Prediction model of disk failure based on adaptive weighted bagging-GBDT algorithm under imbalanced dataset[J]. 2020, 37(3): 14-19.
李新鹏, 高欣, 何杨, 阎博, 孙汉旭, 李军良, 徐建航, 刘震宇, 庞博. 不平衡数据集下基于自适应加权Bagging-GBDT算法的磁盘故障预测模型[J]. 微电子学与计算机, 2020, 37(3): 14-19. DOI：

LI Xin-peng, GAO Xin, HE Yang, et al. Prediction model of disk failure based on adaptive weighted bagging-GBDT algorithm under imbalanced dataset[J]. 2020, 37(3): 14-19. DOI：

摘要

针对磁盘数据集中正负样本数目严重不平衡导致基于机器学习的分类算法易出现故障预测准确率低的问题，本文提出一种基于自适应加权Bagging-GBDT算法的磁盘故障预测模型.首先，提出基于聚类的分层欠采样方法对健康磁盘样本进行多次抽样，解决随机欠采样方法易丢弃潜在有用样本的问题；其次，将每次采样后样本与全部故障磁盘样本组合得到多个样本子集，通过训练这些子集建立多个预测精度较高的GBDT子分类模型；最后，根据待测点邻域样本类别自适应确定各子模型权重，据此通过加权硬投票集成最终的磁盘故障预测模型.在8组KEEL不平衡数据集上实验结果表明，与现有典型不平衡学习算法相比，少数类的召回率平均提升了9.46%；同时在磁盘公开数据集和某调度系统磁盘数据上对比验证了该方法在故障预测率上的先进性.

Abstract

Aiming at the problem that the classification algorithm based on machine learning is prone to low accuracy of fault prediction due to the serious imbalance between the number of positive and negative samples in the disk dataset

this paper proposes a disk fault prediction model based on adaptive weighted Bagging-GBDT algorithm. Firstly

a hierarchical under-sampling method based on clustering algorithm is proposed to sample healthy disk samples several times to solve the problem that the random undersampling method is easy to discard potentially useful samples. Secondly

each sample after sampling is combined with all the failed disk samples to obtain several subsets. By training these subsets

a number of GBDT sub-classification models with higher prediction accuracy are established. Finally

the weights of each sub-model are adaptively determined through the neighborhood sample label of the test sample

and the final disk failure prediction model is integrated by weighted hard voting. The experimental results on 8 sets of KEEL imbalanced datasets show that the recall of the negative is increased by an average of 9.46% compared with the existing typical imbalanced learning algorithm. At the same time

the advancement of the method in the fault prediction rate is verified on disk public datasets and the disk data of a scheduling system.

关键词

Keywords

references

MIKEL GALAR, ALBERTO FERNáADEZ, EDURNE BARRENECHEA, et al. EUSBoost: Enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling[J]. Pattern Recognition, 2013, 46(12):3460-3471. DOI: 3460

SUN Z B, SONG Q B, ZHU X Y, et al.A novel ensemble method for classifying imbalanced data[J]. Pattern Recognition, 2015, 48(5):1623-1637. DOI: 1623

LI J, REBECCA J STONES, WANG G, et al. Hard drive failure prediction using decision trees[J]. Reliability Engineering % System Safety, 2017(164):55-65. DOI: 55

LIN W C, CHIH-FONG TSAI, YA-HAN HU, et al. Clustering-based undersampling in class-imbalanced data [J]. Information Sciences, 2017:409-410. DOI: 409

周宇航, 周志华.代价敏感大间隔分布学习机[J].计算机研究与发展, 2016, 53(9):1964-1970. DOI: 1964

TANG B, HE H B. GIR-based ensemble sampling approaches for imbalanced learning[J].Pattern Recognition, 2017(71):306-319. DOI: 306

杨清波, 李立新, 李宇佳, 等.智能电网调度控制系统试验验证技术[J].电力系统自动化, 2015, 39(1):194-199. DOI: 194

ZHANG C S, LIU C C, ZHANG X L, et al. An up-to-date comparison of state-of-the-art classification algorithms[J]. Expert Systems with Applications, 2017(82):128-150. DOI: 128

CHAWLA N V, BOWYER K W, HALL L C, et al. SMOTE: synthetic minority oversampling technique[J]. Journal of Artificial Intelligence Research, 2002(16):321-357. DOI: 321

JEROME H FRIEDMAN. Greedy function approximation: A gradient boosting machine[J].Annals of Statistics, 2001, 29 (5) :1189-1232. DOI: 1189

李金孟, 林亚平, 祝团飞.基于Hubness与类加权的k最近邻分类算法[J].计算机工程, 2018, 44(4):248-252. DOI: 248

SAMAD NEJATIAN, HAMID PARVIN, ESHAGH FARAJI. Using sub-sampling and ensemble clustering techniques to improve performance of imbalanced classification[J].Neurocomputing, 2018(276):55-66. DOI: 55

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Simulation on the DC characteristics of double heterojunction p-GaN HEMT with AlN/GaN hybrid buffer layer

Aerial small object detection algorithm based on improved RT-DETR

Lightweight countermeasures against Spectre attacks on the branch prediction unit

Research on assembly action recognition based on MSS-YOLO-MPHands fusion architecture

A review of large model development: technological evolution from BERT to Deepseek

Related Author

No data

Related Institution

No data

AI问答

Postal code：100079
Tel：（010）53879206 Email：tmw@bjxintong.com.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09082226号-64 京公网安备11010602201714号
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰