Really Vague? Automatically Identify the Potential False Vagueness within the Context of Documents
Open Access
- 17 May 2023
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 11 (10) , 2334
Abstract
Privacy policies are critical for helping individuals make decisions on the usage of information systems. However, as a common language phenomenon, ambiguity occurs pervasively in privacy policies and largely impedes their usefulness. The existing research focuses on the identification of individual vague words or sentences, without considering the context of documents, which may cause a significant amount of false vagueness. Our goal is to automatically detect the potential false vagueness and the related supporting evidence, which illustrates or explains the vagueness, and therefore probably assist in alleviating the vagueness. We firstly analyze the public manual annotations and define four common patterns of false vagueness and three types of supporting evidence. Then we propose the approach of the F·vague-Detector to automatically detect the supporting evidence and then locate the corresponding potential false vagueness. According to our analysis, about 29–39% of individual vague sentences have at least one clarifying sentence in the documents, and experiments show good performance of our approach, with recall of 66.98–67.95%, precision of 70.59–94.85%, and of 69.24–78.51% on the potential false vagueness detection. Detecting the vagueness of isolated sentences without considering their context within the whole document would bring about one-third potential false vagueness, and our approach can detect this potential false vagueness and the alleviating evidence effectively.
Keywords
Funding Information
- National Natural Science Foundation of China (62102014, 19010201)
- Innovation Fund of Beijing Huaxing Tai Chi Information Technology Co., Ltd. (62102014, 19010201)
This publication has 24 references indexed in Scilit:
- A Theory of Vagueness and Privacy Risk Perception2016
- Mapping Saldaňa’s Coding Methods onto the Literature Review ProcessJournal of Educational Issues, 2016
- The Creation and Analysis of a Website Privacy Policy Corpus2016
- Eddy, a formal language for specifying and analyzing data flow specifications for conflicting privacy requirementsRequirements Engineering, 2013
- Analysing anaphoric ambiguity in natural language requirementsRequirements Engineering, 2011
- User interfaces for privacy agentsACM Transactions on Computer-Human Interaction, 2006
- The C-value/NC-value domain-independent method for multi-word term extractionJournal of Natural Language Processing, 1999
- Grounded Theory and Organizational ResearchThe Journal of Applied Behavioral Science, 1986
- Fuzzy setsInformation and Control, 1965
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960