Gen-AI for User Safety: A Survey
Preprint
Abstract
Machine Learning and data mining techniques (i.e. supervised and unsupervised techniques) are used across domains to detect user safety violations. Examples include classifiers used to detect whether an email is spam or a web-page is requesting bank login information. However, existing ML/DM classifiers are limited in their ability to understand natural languages w.r.t the context and nuances. The aforementioned challenges are overcome with the arrival of Gen-AI techniques, along with their inherent ability w.r.t translation between languages, fine-tuning between various tasks and domains. In this manuscript, we provide a comprehensive overview of the various work done while using Gen-AI techniques w.r.t user safety. In particular, we first provide the various domains (e.g. phishing, malware, content moderation, counterfeit, physical safety) across which Gen-AI techniques have been applied. Next, we provide how Gen-AI techniques can be used in conjunction with various data modalities i.e. text, images, videos, audio, executable binaries to detect violations of user-safety. Further, also provide an overview of how Gen-AI techniques can be used in an adversarial setting. We believe that this work represents the first summarization of Gen-AI techniques for user-safety.Keywords
All Related Versions
This publication has 41 references indexed in Scilit:
- ChatSpamDetector: Leveraging Large Language Models for Effective Phishing Email Detection2025
- PolyGlotFake: A Novel Multilingual and Multimodal DeepFake Dataset2024
- AppPoet: Large language model based android malware detection via multi-view prompt engineeringExpert Systems with Applications, 2024
- Digital deception: generative artificial intelligence in social engineering and phishingArtificial Intelligence Review, 2024
- Assessing LLMs in malicious code deobfuscation of real-world malware campaignsExpert Systems with Applications, 2024
- Better alone than in bad company: Addressing the risks of companion chatbots through data protection by designComputer Law & Security Review, 2024
- Emergence of deepfakes and video tampering detection approaches: A surveyMultimedia Tools and Applications, 2022
- Combining external attention GAN with deep convolutional neural networks for real–fake identification of luxury handbagsThe Visual Computer, 2022
- A comprehensive survey of AI-enabled phishing attacks detection techniquesTelecommunication Systems, 2020
- A transformer-based approach to irony and sarcasm detectionNeural Computing and Applications, 2020