Smartphone-based crosswalk detection and localization for visually impaired pedestrians
- 1 July 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 1-7
Abstract
This paper describes recent work on the “Crosswatch” project, which is a computer vision-based smartphone system developed for providing guidance to blind and visually impaired travelers at traffic intersections. A key function of Crosswatch is self-localization - the estimation of the user's location relative to the crosswalks in the current traffic intersection. Such information may be vital to users with low or no vision to ensure that they know which crosswalk they are about to enter, and are properly aligned and positioned relative to the crosswalk. However, while computer vision-based methods have been used for finding crosswalks and helping blind travelers align themselves to them, these methods assume that the entire crosswalk pattern can be imaged in a single frame of video, which poses a significant challenge for a user who lacks enough vision to know where to point the camera so as to properly frame the crosswalk. In this paper we describe work in progress that tackles the problem of crosswalk detection and self-localization, building on recent work describing techniques enabling blind and visually impaired users to acquire 360° image panoramas while turning in place on a sidewalk. The image panorama is converted to an aerial (overhead) view of the nearby intersection, centered on the location that the user is standing at, so as to facilitate matching with a template of the intersection obtained from Google Maps satellite imagery. The matching process allows crosswalk features to be detected and permits the estimation of the user's precise location relative to the crosswalk of interest. We demonstrate our approach on intersection imagery acquired by blind users, thereby establishing the feasibility of the approach.Keywords
This publication has 9 references indexed in Scilit:
- Crosswatch: a system for providing guidance to visually impaired travelers at traffic intersectionJournal of Assistive Technologies, 2013
- The Crosswatch Traffic Intersection Analyzer: A Roadmap for the Future2012
- Real-time self-localization from panoramic images on mobile devices2011
- Zebralocalizer2011
- Localizing blurry and low-resolution text in natural images2011
- VizWiz2010
- SKYLINE2GPS: Localization in urban canyons using omni-skylines2010
- Real-Time Walk Light Detection with a Mobile Phone2010
- Bipolarity and Projective Invariant-Based Zebra-Crossing Detection for the Visually Impaired2006