Teachable machines for accessibility
Author:
Open Access
- 27 November 2017
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGACCESS Accessibility and Computing
- No. 119,p. 10-18
Abstract
How can accessibility research leverage advances in machine learning and artificial intelligence with limited data? In this article, we argue that teachable machines can empower accessibility research by enabling individuals with disabilities to personalize a data-driven assistive technology. By significantly constraining the conditions of the machine learning task to a specific user and their environment, these technologies can achieve higher robustness in real world scenarios. In contrast to automatic personalization, the end user is called to consciously provide training examples and actively interact with the machine learning algorithm to increase its accuracy. We demonstrate this concept with a concrete example: teachable object recognizers trained by and for blind users. Furthermore, we discuss open challenges in designing and building teachable machines with a focus on accessibility.Keywords
This publication has 19 references indexed in Scilit:
- Isolated Sign Language Recognition with Grassmann Covariance MatricesACM Transactions on Accessible Computing, 2016
- Integrating language models into classifiers for BCI communication: a reviewJournal of Neural Engineering, 2016
- A resource of errors written in Spanish by people with dyslexia and its linguistic, phonetic and visual analysisLanguage Resources and Evaluation, 2016
- Characterizing and visualizing physical world accessibility at scale using crowdsourcing, computer vision, and machine learningACM SIGACCESS Accessibility and Computing, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Learning to Learn, from Transfer Learning to Domain Adaptation: A Unifying Perspective2014
- Collecting and evaluating the CUNY ASL corpus for research on American Sign Language animationComputer Speech & Language, 2014
- Improved inference and autotyping in EEG-based BCI typing systems2013
- The TORGO database of acoustic and articulatory speech from speakers with dysarthriaLanguage Resources and Evaluation, 2011
- Validation of a keystroke-level model for a text entry system used by people with disabilities1994