Jeffrey R. Blum
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jeffrey R. Blum has a total of 34 co-authors. Here are the top co-authors by number of shared publications:
Jeremy R. Cooperstock
McGill University,Centre for Interdisciplinary Research in Music Media and Technology,MontrØal,Canada
11 shared publications- Jeremy R. Cooperstock
McGill University, Montreal, QC, Canada
4 shared publications - Pascal E. Fortin
Department of Computer Science and Mathematics, Université du Québec à Chicoutimi, Chicoutimi, Quebec, Canada
3 shared publications Adriana Olmos
McGill University, Montreal, Quebec, Canada
2 shared publicationsAlexander Eichhorn
Centre for Intelligent Machines, McGill University, Montreal, Canada
1 shared publication- Antoine Weill-Duflos
McGill University,Centre for Interdisciplinary Research in Music Media and Technology,Montreal,Canada
1 shared publication
Latest Publications
- Open Access
- 30 June 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 17 (2) , 1-17
IMAGE: An Open-Source, Extensible Framework for Deploying Accessible Audio and Haptic Renderings of Web Graphics
For accessibility practitioners, creating and deploying novel multimedia interactions for people with disabilities is a nontrivial task. As a result, many projects aiming to support such accessibility needs come and go or never make it to a public release. To reduce the overhead involved in deploying and maintaining a system that transforms web content into multimodal renderings, we created an open source, modular microservices architecture as part of the IMAGE project. This project aims to design richer means of interacting with web graphics than is afforded by a screen reader and text descriptions alone. To benefit the community of accessibility software developers, we discuss this architecture and explain how it provides support for several multimodal processing pipelines. Beyond illustrating the initial use case that motivated this effort, we further describe two use cases outside the scope of our project to explain how a team could use the architecture to develop and deploy accessible solutions for their own work. We then discuss our team’s experience working with the IMAGE architecture, informed by discussions with six project members, and provide recommendations to other practitioners considering applying the framework to their own accessibility projects.
- 30 June 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Accessible Computing
- Vol. 17 (2) , 1-17
Open AccessIMAGE: An Open-Source, Extensible Framework for Deploying Accessible Audio and Haptic Renderings of Web Graphics
For accessibility practitioners, creating and deploying novel multimedia interactions for people with disabilities is a nontrivial task. As a result, many projects aiming to support such accessibility needs come and go or never make it to a public release. To reduce the overhead involved in deploying and maintaining a system that transforms web content into multimodal renderings, we created an open source, modular microservices architecture as part of the IMAGE project. This project aims to design richer means of interacting with web graphics than is afforded by a screen reader and text descriptions alone. To benefit the community of accessibility software developers, we discuss this architecture and explain how it provides support for several multimodal processing pipelines. Beyond illustrating the initial use case that motivated this effort, we further describe two use cases outside the scope of our project to explain how a team could use the architecture to develop and deploy accessible solutions for their own work. We then discuss our team’s experience working with the IMAGE architecture, informed by discussions with six project members, and provide recommendations to other practitioners considering applying the framework to their own accessibility projects.
- 25 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Contact Force Estimation from Raw Photoplethysmogram Signal
Commercial smartwatches and fitness trackers are integrating increasingly advanced physiological sensors. For optimal performance, such devices need to be firmly coupled to the body, yet also remain comfortable when worn for extended periods of time. Existing solutions for measuring the contact force in order to ensure it is in an optimal tightness range typically depend on direct force measurement, but this adds hardware, and therefore cost, to the devices. This paper presents a novel method for estimating contact force by using only an optical heart rate sensor, as already found in many wearable devices. Initial tests indicate that the proposed method can estimate contact force with a mean absolute error of 0.36N, on par with FSRs. This new approach has the potential to expand the utility of existing sensors for both researchers and end-users, with anticipated applications not only in optimizing physiological sensing, but also in haptic information delivery.
- 25 October 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-4
Contact Force Estimation from Raw Photoplethysmogram Signal
Commercial smartwatches and fitness trackers are integrating increasingly advanced physiological sensors. For optimal performance, such devices need to be firmly coupled to the body, yet also remain comfortable when worn for extended periods of time. Existing solutions for measuring the contact force in order to ensure it is in an optimal tightness range typically depend on direct force measurement, but this adds hardware, and therefore cost, to the devices. This paper presents a novel method for estimating contact force by using only an optical heart rate sensor, as already found in many wearable devices. Initial tests indicate that the proposed method can estimate contact force with a mean absolute error of 0.36N, on par with FSRs. This new approach has the potential to expand the utility of existing sensors for both researchers and end-users, with anticipated applications not only in optimizing physiological sensing, but also in haptic information delivery.
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 657-663
Habituation to Pseudo-Ambient Vibrotactile Patterns for Remote Awareness
Habituation is a key aspect of the human sensory processing system. This includes the sense of touch, since it allows our skin receptors to be constantly stimulated, yet largely ignored until something of interest occurs or we consciously focus our attention on the sensations and their meanings. This "ambience" is largely lacking in mobile and wearable systems today, as jarring notifications clamor for our attention. Yet, there are few longitudinal, in-the-wild studies that explore whether and how users can habituate to new ongoing haptic stimuli, especially in practical applications. We report on a three-week in-the-wild study with each participant wearing a vibrotactile device throughout every day. The device rendered two brief vibrotactile pulses every 20 seconds, and varied their durations based on a linked partner’s current activity. Some participants had little difficulty acclimating to the system from the very beginning, but practically all expressed at least some days of annoyance/distraction within the first week. Despite considerable variation among participants, we find a significant drop in both annoyance and distraction over the multiple weeks of the study. A clear majority no longer report annoyance or distraction by the end of the experiment, indicating habituation.
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 657-663
Habituation to Pseudo-Ambient Vibrotactile Patterns for Remote Awareness
Habituation is a key aspect of the human sensory processing system. This includes the sense of touch, since it allows our skin receptors to be constantly stimulated, yet largely ignored until something of interest occurs or we consciously focus our attention on the sensations and their meanings. This "ambience" is largely lacking in mobile and wearable systems today, as jarring notifications clamor for our attention. Yet, there are few longitudinal, in-the-wild studies that explore whether and how users can habituate to new ongoing haptic stimuli, especially in practical applications. We report on a three-week in-the-wild study with each participant wearing a vibrotactile device throughout every day. The device rendered two brief vibrotactile pulses every 20 seconds, and varied their durations based on a linked partner’s current activity. Some participants had little difficulty acclimating to the system from the very beginning, but practically all expressed at least some days of annoyance/distraction within the first week. Despite considerable variation among participants, we find a significant drop in both annoyance and distraction over the multiple weeks of the study. A clear majority no longer report annoyance or distraction by the end of the experiment, indicating habituation.
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 61-67
HapToes: Vibrotactile Numeric Information Delivery via Tactile Toe Display
Tactile rendering of numeric information via a single actuator has been considered for such purposes as fitness progress tracking. However, multi-actuator designs, leveraging spatial mapping, may offer superior performance. Motivated to explore this approach without requiring hardware on the fingers or wrist, we designed HapToes, a novel ten-digit spatial mapping of numeric information to the toes, which overcomes inter-toe discrimination ambiguity. Compared to ActiVibe, a single-actuator wrist-based numeric rendering technique, under similar distraction conditions, HapToes demonstrates equivalent performance for single-value identification, and improved accuracy, response time, and cognitive load when conveying three values sequentially in a single message.
- 1 March 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 61-67
HapToes: Vibrotactile Numeric Information Delivery via Tactile Toe Display
Tactile rendering of numeric information via a single actuator has been considered for such purposes as fitness progress tracking. However, multi-actuator designs, leveraging spatial mapping, may offer superior performance. Motivated to explore this approach without requiring hardware on the fingers or wrist, we designed HapToes, a novel ten-digit spatial mapping of numeric information to the toes, which overcomes inter-toe discrimination ambiguity. Compared to ActiVibe, a single-actuator wrist-based numeric rendering technique, under similar distraction conditions, HapToes demonstrates equivalent performance for single-value identification, and improved accuracy, response time, and cognitive load when conveying three values sequentially in a single message.
- Open Access
- 8 October 2018
- Published by Association for Computing Machinery (ACM)
- p. 17-20
Exploring the Limits of Vibrotactile Numeric Information Delivery
- 8 October 2018
- Published by Association for Computing Machinery (ACM)
- p. 17-20
Open AccessExploring the Limits of Vibrotactile Numeric Information Delivery
- Open Access
- 20 April 2018
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Punching Empathy into Yourself and Others
- 20 April 2018
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessPunching Empathy into Yourself and Others
- Open Access
- 20 October 2017
- Published by Association for Computing Machinery (ACM)
- p. 137-139
Raising the Heat
- 20 October 2017
- Published by Association for Computing Machinery (ACM)
- p. 137-139
Open AccessRaising the Heat
- Open Access
- 12 September 2016
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Grabbing at an angle
This paper investigates the pinch angle as a menu selection technique for two-dimensional foldable textile controllers. Based on the principles of marking menus, the selection of a menu item is performed by grabbing a fold at a specific angle, while changing value is performed by rolling the fold between the fingers. In a first experiment we determined an upper bound for the number of different angles users can reliably grab into a piece of fabric on their forearm. Our results show that users can, without looking at it, reliably grab fabric on their forearm with an average accuracy between 30° and 45°, which would provide up to six different menu options selectable with the initial pinch. In a second experiment, we show that our textile sensor, Grabrics, can detect fold angles at 45° spacing with up to 85% accuracy. Our studies also found that user performance and workload are independent of the fabric types that were tested.
- 12 September 2016
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessGrabbing at an angle
This paper investigates the pinch angle as a menu selection technique for two-dimensional foldable textile controllers. Based on the principles of marking menus, the selection of a menu item is performed by grabbing a fold at a specific angle, while changing value is performed by rolling the fold between the fingers. In a first experiment we determined an upper bound for the number of different angles users can reliably grab into a piece of fabric on their forearm. Our results show that users can, without looking at it, reliably grab fabric on their forearm with an average accuracy between 30° and 45°, which would provide up to six different menu options selectable with the initial pinch. In a second experiment, we show that our textile sensor, Grabrics, can detect fold angles at 45° spacing with up to 85% accuracy. Our studies also found that user performance and workload are independent of the fabric types that were tested.
- Open Access
- 5 November 2015
- Published by Association for Computing Machinery (ACM)
- p. 31-36
Improving Haptic Feedback on Wearable Devices through Accelerometer Measurements
Many variables have been shown to impact whether a vibration stimulus will be perceived. We present a user study that takes into account not only previously investigated predictors such as vibration intensity and duration along with the age of the person receiving the stimulus, but also the amount of motion, as measured by an accelerometer, at the site of vibration immediately preceding the stimulus. This is a more specific measure than in previous studies showing an effect on perception due to gross conditions such as walking. We show that a logistic regression model including prior acceleration is significantly better at predicting vibration perception than a model including only vibration intensity, duration and participant age. In addition to the overall regression, we discuss individual participant differences and measures of classification performance for real-world applications. Our expectation is that haptic interface designers will be able to use such results to design better vibrations that are perceivable under the user's current activity conditions, without being annoyingly loud or jarring, eventually approaching ``perceptually equivalent' feedback independent of motion.
- 5 November 2015
- Published by Association for Computing Machinery (ACM)
- p. 31-36
Open AccessImproving Haptic Feedback on Wearable Devices through Accelerometer Measurements
Many variables have been shown to impact whether a vibration stimulus will be perceived. We present a user study that takes into account not only previously investigated predictors such as vibration intensity and duration along with the age of the person receiving the stimulus, but also the amount of motion, as measured by an accelerometer, at the site of vibration immediately preceding the stimulus. This is a more specific measure than in previous studies showing an effect on perception due to gross conditions such as walking. We show that a logistic regression model including prior acceleration is significantly better at predicting vibration perception than a model including only vibration intensity, duration and participant age. In addition to the overall regression, we discuss individual participant differences and measures of classification performance for real-world applications. Our expectation is that haptic interface designers will be able to use such results to design better vibrations that are perceivable under the user's current activity conditions, without being annoyingly loud or jarring, eventually approaching ``perceptually equivalent' feedback independent of motion.
- Open Access
- 23 September 2014
- Published by Association for Computing Machinery (ACM)
- p. 411-412
Body-worn sensors for remote implicit communication
- 23 September 2014
- Published by Association for Computing Machinery (ACM)
- p. 411-412
Open AccessBody-worn sensors for remote implicit communication