The five Is: Key principles for interpretable and safe conversational AI
Open Access
- 20 November 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 50-54
Abstract
In this position paper, we present five key principles, namely interpretability, inherent capability to explain, independent data, interactive learning, and inquisitiveness, for the development of conversational AI that, unlike the currently popular black box approaches, is transparent and accountable. At present, there is a growing concern with the use of black box statistical language models: While displaying impressive average performance, such systems are also prone to occasional spectacular failures, for which there is no clear remedy. In an effort to initiate a discussion on possible alternatives, we outline and exemplify how our five principles enable the development of conversational AI systems that are transparent and thus safer for use. We also present some of the challenges inherent in the implementation of those principles.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Conversational agents in business: A systematic literature review and future research directionsComputer Science Review, 2020
- A Survey of the Usages of Deep Learning for Natural Language ProcessingIEEE Transactions on Neural Networks and Learning Systems, 2020
- Ethical implications of conversational agents in global public healthBulletin of the World Health Organization, 2020
- The global landscape of AI ethics guidelinesNature Machine Intelligence, 2019
- Stop explaining black box machine learning models for high stakes decisions and use interpretable models insteadNature Machine Intelligence, 2019
- Conversational agents in healthcare: a systematic reviewJournal of the American Medical Informatics Association, 2018
- A Syntactic Neural Model for General-Purpose Code Generation2017
- POMDP-Based Statistical Spoken Dialog Systems: A ReviewProceedings of the IEEE, 2013
- Language, logic and ontology: Uncovering the structure of commonsense knowledgeInternational Journal of Human-Computer Studies, 2007
- Reformulating software engineering as a search problemIEE Proceedings - Software, 2003