Toward Bootstrapping-Free Homomorphic Encryption-Based GRU Network for Text Classification
Open Access
- 3 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 94008-94017
Abstract
Homomorphic encryption (HE) is a promising method in privacy-preserving cloud computing. Applying HE on feedforwad neural networks has been frequently reported recently but the research on recurrent neural networks is still insufficient. In previous studies, HE-based GRU is built with bootstrapping due to the changeable input length and large number of required multiplications, which is not time-efficient. In this study, we give a guideline of building bootstrapping-free HE-based GRU for text classification tasks. We discuss the methods of pre-processing of texts to decrease the input sequence length but keep the accuracy in a comparable level as the original GRU. The architecture of GRU is designed with flexibility to process the input sequence with different lengths while fixing the recurrent steps. At last, the HE parameter selection is discussed.We analyze the noise raised from HE operations and select the parameter that ensure the results from encrypted data are the same as that on plaintexts. The proposed model is evaluated on 6 popular text datasets, and the results show that the accuracy is only lower than the original GRU by at most 4.2%. Despite the complicated calculations in GRU models, the model is light-weighted and the fastest inference in our implementations costs only 10 minutes.We show the potential of applying HE schemes on complex models without bootstrapping to achieve fast encrypted computations.Keywords
This publication has 25 references indexed in Scilit:
- High-Throughput Privacy-Preserving GRU Network with Homomorphic Encryption2023
- Privacy-Preserving Machine Learning With Fully Homomorphic Encryption for Deep Neural NetworkIEEE Access, 2022
- Non-interactive Privacy Preserving Recurrent Neural Network Prediction with Homomorphic Encryption2021
- DOReN: Toward Efficient Deep Convolutional Neural Networks with Fully Homomorphic EncryptionIEEE Transactions on Information Forensics and Security, 2021
- Efficient Bootstrapping for Approximate Homomorphic Encryption with Non-sparse Keys2021
- Towards the AlexNet Moment for Homomorphic Encryption: HCNN, the First Homomorphic CNN on Encrypted Data With GPUsIEEE Transactions on Emerging Topics in Computing, 2020
- CryptoRNN - Privacy-Preserving Recurrent Neural Networks Using Homomorphic Encryption2020
- Better Bootstrapping for Approximate Homomorphic Encryption2020
- Privacy-preserving cloud computing on sensitive data: A survey of methods, products and challengesComputer Communications, 2019
- Homomorphic Encryption for Arithmetic of Approximate Numbers2017