“Hands On” Visual Recognition for Visually Impaired Users
Authors:
Open Access
- 11 August 2017
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 10 (3) , 1-30
Abstract
Blind or visually impaired (BVI) individuals are capable of identifying an object in their hands by combining the available visual cues (if available) with manipulation. It is harder for them to associate the object with a specific brand, a model, or a type. Starting from this observation, we propose a collaborative system designed to deliver visual feedback automatically and to help the user filling this semantic gap. Our visual recognition module is implemented by means of an image retrieval procedure that provides real-time feedback, performs the computation locally on the device, and is scalable to new categories and instances. We carry out a thorough experimental analysis of the visual recognition module, which includes a comparative analysis with the state of the art. We also present two different system implementations that we test with the help of BVI users to evaluate the technical soundness, the usability, and the effectiveness of the proposed concept.Keywords
Funding Information
- GLASSENSE
This publication has 59 references indexed in Scilit:
- Computer vision-based object recognition for the visually impaired in an indoors environment: a surveyThe Visual Computer, 2013
- Toward a computer vision-based wayfinding aid for blind persons to access unfamiliar indoor environmentsMachine Vision and Applications, 2012
- (Computer) vision without sightCommunications of the ACM, 2012
- Global estimates of visual impairment: 2010British Journal of Ophthalmology, 2011
- The MOPED framework: Object recognition and pose estimation for manipulationThe International Journal of Robotics Research, 2011
- Amazon's Mechanical TurkPerspectives on Psychological Science, 2011
- Improving Bag-of-Features for Large Scale Image SearchInternational Journal of Computer Vision, 2009
- FUNCTIONAL ASSESSMENT OF A CAMERA PHONE-BASED WAYFINDING SYSTEM OPERATED BY BLIND AND VISUALLY IMPAIRED USERSInternational Journal on Artificial Intelligence Tools, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Blind Navigation and the Role of Technology2008