HOU Xiao-jun, LI Ze-hua, LI Ze-kun. Research on differentially private classification algorithm based on layer-wise relevance propagation[J]. 2021, 38(5): 48-53.
HOU Xiao-jun, LI Ze-hua, LI Ze-kun. Research on differentially private classification algorithm based on layer-wise relevance propagation[J]. 2021, 38(5): 48-53.DOI:
To prevent attackers from restoring the training dataset and to protect the input image during the application process of deep learning image classification model
a differential privacy classification algorithm based on LRP (Layer-wise Relevance Propagation) is proposed in the paper. The relevance between image features is firstly quantified according to LRP in the proposed algorithm
then adaptive noise is added to the loss function based on feature relevance and Adam mechanism is used for model optimization. Finally
a differential private transform layer is constructed to perturb the input image and privacy budget is assigned according to feature relevance during model application stage. Experimental results show that the proposed algorithm achieves high classification accuracy in condition of privacy preservation.
关键词
Keywords
references
PHAN N H, WANG Y, WU X T, et al. Differential privacy preservation for deep auto-encoders: an application of human behavior prediction[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Phoenix: AAAI, 2016: 1309-1316.
ZHAO J W, CHEN Y F, ZHANG W. Differential privacy preservation in deep learning: challenges, opportunities and solutions[J]. IEEE Access, 2019(7): 48901-48911. DOI: 10.1109/ACCESS.2019.2909559.
ABADI M, CHU A, GOODFELLOW I, et al. Deep learning with differential privacy[C]//Proceedings of 2016 ACM SIGSAC Conference on Computer and Communications Security. Vienna: ACM, 2016: 308-318. DOI: 10.1145/2976749.2978318.
FREDRIKSON M, LANTZ E, JHA S, et al. Privacy in pharmacogenetics: an end-to-end case study of personalized warfarin dosing[C]//Proceedings of the 23rd USENIX Conference on Security Symposium. San Diego: USENIX Association, 2014. DOI: 10.5555/2671225.2671227.
HAEBERLEN A, PIERCE B C, NARAYAN A. Differential privacy under fire[C]//Proceedings of the 20th USENIX Conference on Security. San Francisco: USENIX Association, 2011: 33. DOI: 10.5555/2028067.2028100.
MCSHERRY F D. Privacy integrated queries: an extensible platform for privacy-preserving data analysis[C]//Proceedings of 2009 ACM SIGMOD International Conference on Management of Data. Providence: ACM, 2009: 19-30. DOI: 10.1145/1559845.1559850.
XIE L Y, LIN K X, WANG S, et al. Differentially private generative adversarial network[J]. arXiv: 1802.06739, 2018.
PHAN N H, WU X T, HU H, et al. Adaptive Laplace mechanism: differential privacy preservation in deep learning[C]//Proceedings of 2017 IEEE International Conference on Data Mining. New Orleans: IEEE, 2017: 385-394. DOI: 10.1109/ICDM.2017.48.
DWORK C. Differential privacy[C]//Proceedings of the 33rd International Colloquium on Automata, Languages, and Programming. Venice, Italy: Springer, 2006. DOI: 10.1007/11787006_1.
BACH S, BINDER A, MONTAVON G, et al. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation[J]. PLoS One, 2015, 10(7): e0130140. DOI: 10.1371/journal.pone.0130140.
PHAN N H, WU X T, DOU D J. Preserving differential privacy in convolutional deep belief networks[J]. Machine Learning, 2017, 106(9-10): 1681-1704. DOI: 10.1007/s10994-017-5656-2.
新疆大学 软件学院 新疆大数据与智能软件工程研究中心, 新疆 乌鲁木齐 830091Xinjiang Engineering Research Center of Big Data and Intelligent Software, School of Software, Xinjiang University, Urumqi 830091, China
新疆大学 软件工程重点实验室, 新疆 乌鲁木齐 830091Key Laboratory of Software Engineering, Xinjiang University, Urumqi 830091, China
新疆大学 计算机科学与技术学院, 新疆 乌鲁木齐 830046School of Computer Science and Technology, Xinjiang University, Urumqi 830046, China
新疆师范大学, 新疆 乌鲁木齐 830054Xinjiang Normal University, Urumqi 830054, China