Modeling Discolsive Transparency in NLP Application Descriptions
Authors:
Preprint
Abstract
Broader disclosive transparency$-$truth and clarity in communication regarding the function of AI systems$-$is widely considered desirable. Unfortunately, it is a nebulous concept, difficult to both define and quantify. Previous work has suggested that a trade-off exists between greater disclosive transparency and user confusion, where 'too much information' clouds a reader's understanding of what a system description means. We address both of these issues by connecting disclosive transparency to a "replication room" thought experiment, where the person describing the system attempts to convey the requisite information for a third party to reconstruct it. In this setting, the degree to which the necessary information is conveyed represents the description's transparency, and the level of expertise needed by the third party corresponds to potential user confusion. We introduce two neural language model-based probabilistic metrics to model these factors, and demonstrate that they correlate with user and expert opinions of system transparency, making them a valid objective proxy. Finally, we apply these metrics to study the relationships between transparency, confusion, and user perceptions in a corpus of NLP demo abstracts.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Datasheets for datasetsCommunications of the ACM, 2021
- Robust Estimation of Hypernasality in Dysarthria With Acoustic Model Likelihood FeaturesIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2020
- Factors Influencing Perceived Fairness in Algorithmic Decision-Making2020
- An empirical study on the perceived fairness of realistic, imperfect machine learning models2020
- FactSheets: Increasing trust in AI services through supplier's declarations of conformityIBM Journal of Research and Development, 2019
- Robots and Transparency: The Multiple Dimensions of Transparency in the Context of Robot TechnologiesIEEE Robotics & Automation Magazine, 2019
- Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making2018
- How Much Information?2016
- A path to understanding the effects of algorithm awareness2014
- Trust in automation: Part I. Theoretical issues in the study of trust and human intervention in automated systemsErgonomics, 1994