RASSAR: Room Accessibility and Safety Scanning in Augmented Reality
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Abstract
The safety and accessibility of our homes is critical to quality of life and evolves as we age, become ill, host guests, or experience life events such as having children. Researchers and health professionals have created assessment instruments such as checklists that enable homeowners and trained experts to identify and mitigate safety and access issues. With advances in computer vision, augmented reality (AR), and mobile sensors, new approaches are now possible. We introduce RASSAR, a mobile AR application for semi-automatically identifying, localizing, and visualizing indoor accessibility and safety issues such as an inaccessible table height or unsafe loose rugs using LiDAR and real-time computer vision. We present findings from three studies: a formative study with 18 participants across five stakeholder groups to inform the design of RASSAR, a technical performance evaluation across ten homes demonstrating state-of-the-art performance, and a user study with six stakeholders. We close with a discussion of future AI-based indoor accessibility assessment tools, RASSAR’s extensibility, and key application scenarios.Keywords
All Related Versions
Funding Information
- UW Reality Lab
- Meta
- NSF GRFP
- NSF (National Science Foundation) (1834269)
- Center for Research and Education on Accessible Technology and Experiences (CREATE)
This publication has 43 references indexed in Scilit:
- A semantic framework for on-site evacuation routing based on awareness of obstacle accessibilityAutomation in Construction, 2022
- Evaluation of the Apple iPhone 12 Pro LiDAR for an Application in GeosciencesScientific Reports, 2021
- Assessing bikeability with street view imagery and computer visionTransportation Research Part C: Emerging Technologies, 2021
- Strategically Using Applied Machine Learning for Accessibility Documentation in the Built Environment2021
- Human-centric metrics for indoor scene assessment and synthesisGraphical Models, 2020
- The Open Images Dataset V4International Journal of Computer Vision, 2020
- Automatic building accessibility diagnosis from point cloudsAutomation in Construction, 2017
- Indoor Spatial Model and Accessibility Index for Emergency Evacuation of People with DisabilitiesJournal of Computing in Civil Engineering, 2016
- Urban accessibility diagnosis from mobile laser scanning dataISPRS Journal of Photogrammetry and Remote Sensing, 2013
- Changes in accessibility and usability in housing: an exploration of the housing adaptation processOccupational Therapy International, 2005