内蒙古科技大学 机构 信息工程学院,内蒙古,包头,014000
纸质出版:2018
移动端阅览
刘月峰, 张亚斌, 苑江浩. 云环境下NB算法的垃圾邮件过滤研究[J]. 微电子学与计算机, 2018, 35(8): 60-63.
LIU Yue-feng, ZHANG Ya-bin, YUAN Jiang-hao. Research of Spam Filtering Based on NB Algorithm in Cloud Environment[J]. 2018, 35(8): 60-63.
朴素贝叶斯算法在解决垃圾邮件分类领域内具有较高的准确性
能够很好的将邮件区分开来
但是在分类前期的训练阶段却会大量耗用系统和网络资源
严重影响分类效率.为此引入spark平台.以并行的思想去解决邮件分类问题
利用spark计算平台RDD的血缘关系合理的安排NB邮件分类的各个过程.实验结果表明
与其他传统的分类方法对比而言
朴素贝叶斯在精确率
召回率等方面具有很好的效果
并且与传统单机下的邮件分类
本次实验因引入分布式的思想
利用spark集群的优势大大加快了分类的速率.
NaÏve Bayes algorithm has high accuracy in solving the spam classification field and can distinguish the mail very well. However
in the pre-classification training phase
it consumes a lot of system and network resources and seriously affects the classification efficiency. Spark platform for this introduction. With parallel thinking to solve the problem of mail classification
the use of spark computing platform RDD kinship rational arrangement of NB mail classification of the various processes. The experimental results show that
compared with other traditional classification methods
Na?ve Bayes has a good effect on the Precision and Recall rate
etc.
and with the traditional mail classification under single machine
this experiment because of the introduction of distributed thinking
The use of spark clusters greatly accelerate the classification speed.
Ramírez-Gallego S, Krawczyk B, García S, et al. Nearest neighbor classification for high-speed big data streams using spark[J]. IEEE Transactions on Systems Man % Cybernetics Systems, 2017(99):1-13. DOI: 1
刘月峰, 苑江浩, 张晓琳.改进NB算法在垃圾邮件过滤技术中的研究[J].微电子学与计算机, 2017, 34(4):115-120. DOI: 115
方言.邮件安全不容忽视[J].中国信息安全, 2017, 7(3):100-100. DOI: 100
张铭锋, 李云春, 李巍.垃圾邮件过滤的贝叶斯方法综述[J].计算机应用研究, 2005, 22(8):14-19. DOI: 14
王雯, 赵衎衎, 李翠平, 等. Spark平台下的短文本特征扩展与分类研究[J].计算机科学与探索, 2017, 11(5):732-741. DOI: 732
于苹苹, 倪建成, 姚彬修, 等.基于Spark框架的高效KNN中文文本分类算法[J].计算机应用, 2016, 36(12):3292-3297. DOI: 3292
陶永才, 薛正元, 石磊.基于MapReduce的贝叶斯垃圾邮件过滤机制[J].计算机应用, 2011, 31(9):2412-2416. DOI: 2412
李涛, 刘斌. Spark平台下的高效Web文本分类系统的研究[J].计算机应用与软件, 2016, 33(11):33-36. DOI: 33
Davoodi M, Segal S, Peretz N K, et al. Semi-automated program for analysis of local Ca 2+, spark release with application for classification of heart cell type[J]. Cell Calcium, 2017(64):83-90. DOI: 83
曾青华, 袁家斌, 张云洲.基于Hadoop的贝叶斯过滤MapReduce模型[J].计算机工程, 2013, 39(11):57-60. DOI: 57
Geng Y, Zhang J. Optimized parallelization of binary classification algorithms based on spark[J]. IEEE Robotics % Automation Magazine, 2006, 13(4):11-13. DOI: 11
Ding Q, Boykin R. A framework for distributed nearest neighbor classification using Hadoop[J]. Journal of Computational Methods in Sciences % Engineering, 2016(17):1-9. DOI: 1
0
浏览量
5
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010602201714号