Michael Malcolm
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Michael Malcolm has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
- Basel Hindi
Columbia University, United States
4 shared publications - Brian A. Smith
Columbia University, New York, New York, USA
4 shared publications - Gaurav Jain
Columbia University, New York, New York, USA
4 shared publications - Xin Yi Therese Xu
Pomona College, United States
4 shared publications - Connor Courtien
Hunter College, United States
2 shared publications - Conrad Wyrick
University of Florida, United States
2 shared publications
Latest Publications
- Open Access
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
StreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrians
Blind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS’s inaccuracy, however, causes them to veer off track, run into obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via hardware installations, enabling this outdoors remains a challenge. Interestingly, many outdoor environments are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing existing street cameras for outdoor navigation. Our community-driven approach considers both technical and sociotechnical concerns through engagements with various stakeholders: BLV users, residents, business owners, and Community Board leadership. The resulting system, StreetNav, processes a camera’s video feed using computer vision and gives BLV pedestrians real-time navigation assistance. Our evaluations show that StreetNav guides users more precisely than GPS, but its technical performance is sensitive to environmental occlusions and distance from the camera. We discuss future implications for deploying such systems at scale.
- 11 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Open AccessStreetNav: Leveraging Street Cameras to Support Precise Outdoor Navigation for Blind Pedestrians
Blind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS’s inaccuracy, however, causes them to veer off track, run into obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via hardware installations, enabling this outdoors remains a challenge. Interestingly, many outdoor environments are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing existing street cameras for outdoor navigation. Our community-driven approach considers both technical and sociotechnical concerns through engagements with various stakeholders: BLV users, residents, business owners, and Community Board leadership. The resulting system, StreetNav, processes a camera’s video feed using computer vision and gives BLV pedestrians real-time navigation assistance. Our evaluations show that StreetNav guides users more precisely than GPS, but its technical performance is sensitive to environmental occlusions and distance from the camera. We discuss future implications for deploying such systems at scale.
- Open Access
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Front Row: Automatically Generating Immersive Audio Representations of Tennis Broadcasts for Blind Viewers
Blind and low-vision (BLV) people face challenges watching sports due to the lack of accessibility of sports broadcasts. Currently, BLV people rely on descriptions from TV commentators, radio announcers, or their friends to understand the game. These descriptions, however, do not allow BLV viewers to visualize the action by themselves. We present Front Row, a system that automatically generates an immersive audio representation of sports broadcasts, specifically tennis, allowing BLV viewers to more directly perceive what is happening in the game. Front Row first recognizes gameplay from the video feed using computer vision, then renders players’ positions and shots via spatialized (3D) audio cues. User evaluations with 12 BLV participants show that Front Row gives BLV viewers a more accurate understanding of the game compared to TV and radio, enabling viewers to form their own opinions on players’ moods and strategies. We discuss future implications of Front Row and illustrate several applications, including a Front Row plug-in for video streaming platforms to enable BLV people to visualize the action in sports videos across the Web.
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessFront Row: Automatically Generating Immersive Audio Representations of Tennis Broadcasts for Blind Viewers
Blind and low-vision (BLV) people face challenges watching sports due to the lack of accessibility of sports broadcasts. Currently, BLV people rely on descriptions from TV commentators, radio announcers, or their friends to understand the game. These descriptions, however, do not allow BLV viewers to visualize the action by themselves. We present Front Row, a system that automatically generates an immersive audio representation of sports broadcasts, specifically tennis, allowing BLV viewers to more directly perceive what is happening in the game. Front Row first recognizes gameplay from the video feed using computer vision, then renders players’ positions and shots via spatialized (3D) audio cues. User evaluations with 12 BLV participants show that Front Row gives BLV viewers a more accurate understanding of the game compared to TV and radio, enabling viewers to form their own opinions on players’ moods and strategies. We discuss future implications of Front Row and illustrate several applications, including a Front Row plug-in for video streaming platforms to enable BLV people to visualize the action in sports videos across the Web.
- Open Access
- 22 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Towards Street Camera-based Outdoor Navigation for Blind Pedestrians
- 22 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessTowards Street Camera-based Outdoor Navigation for Blind Pedestrians
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Towards Accessible Sports Broadcasts for Blind and Low-Vision Viewers
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessTowards Accessible Sports Broadcasts for Blind and Low-Vision Viewers