NaÏve Bayes algorithm has high accuracy in solving the spam classification field and can distinguish the mail very well. However
in the pre-classification training phase
it consumes a lot of system and network resources and seriously affects the classification efficiency. Spark platform for this introduction. With parallel thinking to solve the problem of mail classification
the use of spark computing platform RDD kinship rational arrangement of NB mail classification of the various processes. The experimental results show that
compared with other traditional classification methods
Na?ve Bayes has a good effect on the Precision and Recall rate
etc.
and with the traditional mail classification under single machine
this experiment because of the introduction of distributed thinking
The use of spark clusters greatly accelerate the classification speed.
关键词
Keywords
references
Ramírez-Gallego S, Krawczyk B, García S, et al. Nearest neighbor classification for high-speed big data streams using spark[J]. IEEE Transactions on Systems Man % Cybernetics Systems, 2017(99):1-13. DOI: 1
Davoodi M, Segal S, Peretz N K, et al. Semi-automated program for analysis of local Ca 2+, spark release with application for classification of heart cell type[J]. Cell Calcium, 2017(64):83-90. DOI: 83
Geng Y, Zhang J. Optimized parallelization of binary classification algorithms based on spark[J]. IEEE Robotics % Automation Magazine, 2006, 13(4):11-13. DOI: 11
Ding Q, Boykin R. A framework for distributed nearest neighbor classification using Hadoop[J]. Journal of Computational Methods in Sciences % Engineering, 2016(17):1-9. DOI: 1