A New Pipeline for Snooping Keystroke Based on Deep Learning Algorithm
Open Access
- 29 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 24498-24514
Abstract
This research focuses on the vulnerability issues related to keystroke logging on a physical computer keyboard, known as Snooping Keystrokes. This category of attacks occurs recording an audio track with a smartphone while typing on the keyboard, and processing the audio to detect individual pressed keys. To address this issue, mathematical wavelet transforms have been tested, and key recognition has been implemented using the inference test of a deep learning model based on a Temporal Convolutional Network (TCN). The novelty of the proposed pipeline lies in its dynamic audio analysis and keystroke recognition, which splits the wave based on audio signal peaks generated by key presses. This approach enables an attack in real-world conditions without knowing the exact number of keystrokes typed by the user. Experimental results for the proposed pipeline show a peak accuracy of 98.3%.Keywords
This publication has 23 references indexed in Scilit:
- Acoustic Side Channel Attack for Keystroke Splitting in the Wild2024
- A New Deep Learning Pipeline for Acoustic Attack on Keyboards2024
- A Practical Deep Learning-Based Acoustic Side Channel Attack on Keyboards2023
- Data Augmentation using Reverb and Noise in Deep Learning Implementation of Cough Classification2023
- Temporal Convolutional Networks with RNN approach for chaotic time series predictionApplied Soft Computing, 2022
- TATCN: Time Series Prediction Model Based on Time Attention Mechanism and TCN2022
- Parallel spatio-temporal attention-based TCN for multivariate time series predictionNeural Computing and Applications, 2021
- Keyboard acoustic side channel attacks: exploring realistic and security-sensitive scenariosInternational Journal of Information Security, 2014
- Keyboard acoustic emanations2004
- The wavelet transform, time-frequency localization and signal analysisIEEE Transactions on Information Theory, 1990