Penghao Dong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Penghao Dong has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Shanshan Yao
Department of Mechanical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
9 shared publications - Yizong Li
Department of Mechanical Engineering Stony Brook University Stony Brook New York USA
4 shared publications Si Chen
Department of Mechanical Engineering, Stony Brook University, Stony Brook, NY 11794, USA
3 shared publicationsSu Li
Department of Mechanical Engineering, Stony Brook University (State University of New York at Stony Brook), Stony Brook, NY 11794, USA
3 shared publications- Si Chen
Department of Mechanical Engineering, Stony Brook University (State University of New York at Stony Brook), Stony Brook, NY 11794, USA
2 shared publications - Anisha Parsan1 shared publication
Latest Publications
- 19 February 2026
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 13 (8) , 4155-4169
Programming magnetic composites and phase change materials for multimodal haptic interfaces with integrated self-sensing toward adaptive and proprioceptive haptic feedback
Enabled by programmable soft magnetic composites, the compact, skin-conformal, self-sensing haptic interface seamlessly delivers three distinct modes of haptic feedback: normal, rotational shear, and skin stretch.
- 19 February 2026
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 13 (8) , 4155-4169
Programming magnetic composites and phase change materials for multimodal haptic interfaces with integrated self-sensing toward adaptive and proprioceptive haptic feedback
Enabled by programmable soft magnetic composites, the compact, skin-conformal, self-sensing haptic interface seamlessly delivers three distinct modes of haptic feedback: normal, rotational shear, and skin stretch.
- Open Access
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-30
MagSkin: Enabling Touchless Human-Computer Interaction with Soft Epidermal Magnetic Material
Soft epidermal magnetic material has demonstrated excellent flexibility and wearability across a range of emerging applications, e.g., pressure sensing, robotics, among others. In this paper, we build a flexible magnetic skin based system MagSkin for touchless Human Computer Interaction (HCI). For example, a user can wear a Bandaid-like sticker on his fingertip to operate a smartphone using classic gestures without touching the screen, i.e., tap virtual icons floating on top of the screen. The magnetic skin is specially fabricated with randomly distributed magnetic microparticles, so that any shape change of the skin will cause position and orientation changes of those particles, introducing complex variations of the magnetic field around the skin. To characterize the magnetic field of the magnetic skin, we designed a multi-dipole based model. Based on this model, we developed 6-DoF position tracking and orientation estimation algorithms to localize the skin precisely. We also designed novel gestures, e.g., finger bend and pinch, for users to make input/adjustment based on the flexibility of the material. We have conducted experiments with 15 volunteers for 18 hours, experimental results show localization accuracy is 6.2 mm in 3D, 4.5 mm in 2D, and recognition accuracy is 94% for classical gesture and 92% for novel gesture.
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-30
Open AccessMagSkin: Enabling Touchless Human-Computer Interaction with Soft Epidermal Magnetic Material
Soft epidermal magnetic material has demonstrated excellent flexibility and wearability across a range of emerging applications, e.g., pressure sensing, robotics, among others. In this paper, we build a flexible magnetic skin based system MagSkin for touchless Human Computer Interaction (HCI). For example, a user can wear a Bandaid-like sticker on his fingertip to operate a smartphone using classic gestures without touching the screen, i.e., tap virtual icons floating on top of the screen. The magnetic skin is specially fabricated with randomly distributed magnetic microparticles, so that any shape change of the skin will cause position and orientation changes of those particles, introducing complex variations of the magnetic field around the skin. To characterize the magnetic field of the magnetic skin, we designed a multi-dipole based model. Based on this model, we developed 6-DoF position tracking and orientation estimation algorithms to localize the skin precisely. We also designed novel gestures, e.g., finger bend and pinch, for users to make input/adjustment based on the flexibility of the material. We have conducted experiments with 15 volunteers for 18 hours, experimental results show localization accuracy is 6.2 mm in 3D, 4.5 mm in 2D, and recognition accuracy is 94% for classical gesture and 92% for novel gesture.
- 19 May 2025
- Published by Wiley in Advanced Materials Technologies
- Vol. 10 (16)
Unobtrusive Swallow Monitoring Enabled by Conformal IONOGEL Biopotential Electrodes and Machine Learning
Dysphagia or difficulty swallowing is caused by the failure of neurological pathways to properly activate swallowing muscles. Current electromyography (EMG) systems for dysphagia monitoring are bulky and rigid, limiting their potential for long‐term and unobtrusive use. To address this, a machine learning‐assisted wearable EMG system is presented, utilizing self‐adhesive, skin‐conformal, semi‐transparent, and robust ionic gel electrodes. The presented electrodes possess good conductivity, superior skin contact, and good transmittance, ensuring high‐fidelity EMG sensing without impeding daily activities. Moreover, the optimized material and structural designs ensure wearing comfort and conformable skin‐electrode contact, allowing for long‐term monitoring with high accuracy. Machine learning and mel‐frequency cepstral coefficient techniques are employed to classify swallowing events based on food types and volumes. Through an analysis of electrode placement on the chin and neck, the proposed system is able to effectively distinguish between different food types and water volumes using a small number of channels, making it suitable for continuous dysphagia monitoring. This work represents an advancement in machine learning assisted EMG systems for the classification and regression of swallowing events, paving the way for more efficient, unobtrusive, and long‐term dysphagia monitoring systems.
- 19 May 2025
- Published by Wiley in Advanced Materials Technologies
- Vol. 10 (16)
Unobtrusive Swallow Monitoring Enabled by Conformal IONOGEL Biopotential Electrodes and Machine Learning
Dysphagia or difficulty swallowing is caused by the failure of neurological pathways to properly activate swallowing muscles. Current electromyography (EMG) systems for dysphagia monitoring are bulky and rigid, limiting their potential for long‐term and unobtrusive use. To address this, a machine learning‐assisted wearable EMG system is presented, utilizing self‐adhesive, skin‐conformal, semi‐transparent, and robust ionic gel electrodes. The presented electrodes possess good conductivity, superior skin contact, and good transmittance, ensuring high‐fidelity EMG sensing without impeding daily activities. Moreover, the optimized material and structural designs ensure wearing comfort and conformable skin‐electrode contact, allowing for long‐term monitoring with high accuracy. Machine learning and mel‐frequency cepstral coefficient techniques are employed to classify swallowing events based on food types and volumes. Through an analysis of electrode placement on the chin and neck, the proposed system is able to effectively distinguish between different food types and water volumes using a small number of channels, making it suitable for continuous dysphagia monitoring. This work represents an advancement in machine learning assisted EMG systems for the classification and regression of swallowing events, paving the way for more efficient, unobtrusive, and long‐term dysphagia monitoring systems.
- 29 November 2024
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 12 (5) , 1568-1580
Thermally responsive spatially programmable soft actuators with multiple response states enabled by Grayscale UV light processing
This work presents a scalable grayscale UV technique for fabricating spatially programmable soft actuators with diverse actuation behaviors in one actuator. The advanced programmability lays the foundation for soft robotics and adaptive devices.
- 29 November 2024
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 12 (5) , 1568-1580
Thermally responsive spatially programmable soft actuators with multiple response states enabled by Grayscale UV light processing
This work presents a scalable grayscale UV technique for fabricating spatially programmable soft actuators with diverse actuation behaviors in one actuator. The advanced programmability lays the foundation for soft robotics and adaptive devices.
- 1 October 2024
- Published by Wiley in Advanced Materials Technologies
- Vol. 10 (4)
Decoding Silent Speech Cues From Muscular Biopotential Signals for Efficient Human‐Robot Collaborations
Silent speech interfaces offer an alternative and efficient communication modality for individuals with voice disorders and when the vocalized speech communication is compromised by noisy environments. Despite the recent progress in developing silent speech interfaces, these systems face several challenges that prevent their wide acceptance, such as bulkiness, obtrusiveness, and immobility. Herein, the material optimization, structural design, deep learning algorithm, and system integration of mechanically and visually unobtrusive silent speech interfaces are presented that can realize both speaker identification and speech content identification. Conformal, transparent, and self‐adhesive electromyography electrode arrays are designed for capturing speech‐relevant muscle activities. Temporal convolutional networks are employed for recognizing speakers and converting sensing signals into spoken content. The resulting silent speech interfaces achieve a 97.5% speaker classification accuracy and 91.5% keyword classification accuracy using four electrodes. The speech interface is further integrated with an optical hand‐tracking system and a robotic manipulator for human‐robot collaboration in both assembly and disassembly processes. The integrated system achieves the control of the robot manipulator by silent speech and facilitates the hand‐over process by hand motion trajectory detection. The developed framework enables natural robot control in noisy environments and lays the ground for collaborative human‐robot tasks involving multiple human operators.
- 1 October 2024
- Published by Wiley in Advanced Materials Technologies
- Vol. 10 (4)
Decoding Silent Speech Cues From Muscular Biopotential Signals for Efficient Human‐Robot Collaborations
Silent speech interfaces offer an alternative and efficient communication modality for individuals with voice disorders and when the vocalized speech communication is compromised by noisy environments. Despite the recent progress in developing silent speech interfaces, these systems face several challenges that prevent their wide acceptance, such as bulkiness, obtrusiveness, and immobility. Herein, the material optimization, structural design, deep learning algorithm, and system integration of mechanically and visually unobtrusive silent speech interfaces are presented that can realize both speaker identification and speech content identification. Conformal, transparent, and self‐adhesive electromyography electrode arrays are designed for capturing speech‐relevant muscle activities. Temporal convolutional networks are employed for recognizing speakers and converting sensing signals into spoken content. The resulting silent speech interfaces achieve a 97.5% speaker classification accuracy and 91.5% keyword classification accuracy using four electrodes. The speech interface is further integrated with an optical hand‐tracking system and a robotic manipulator for human‐robot collaboration in both assembly and disassembly processes. The integrated system achieves the control of the robot manipulator by silent speech and facilitates the hand‐over process by hand motion trajectory detection. The developed framework enables natural robot control in noisy environments and lays the ground for collaborative human‐robot tasks involving multiple human operators.
- 22 February 2024
- Published by Wiley in Advanced Functional Materials
- Vol. 34 (17)
Multimodal 5‐DOF Stretchable Electromagnetic Actuators toward Haptic Information Delivery
The rapid advancements in artificial intelligence, particularly in the domains of robotics, prosthetics, and virtual and augmented reality (VR/AR), have driven an escalating demand for intuitive and effective human–machine interactions. Consequently, haptic devices, being electronic displays for the sense of touch, have drawn increasing attention. More efforts are in demand to develop stretchable and lightweight haptic devices that can trigger multiple mechanical cutaneous receptors using a single device. This work presents a new 3‐modal 5‐DOF stretchable haptic interface that is enabled by electromagnetic actuators and high‐fidelity multi‐layer metal printing. The haptic device renders rich haptic sensations (i.e., normal force, vibration, angular force, skin dragging) in one device, allowing for the comprehensive delivery of tactile information through the excitation of multiple cutaneous receptors. Additionally, haptic devices are designed to be compact, lightweight, and skin‐compatible. The skin‐like softness and stretchability enable intimate skin contact, which is crucial for efficient haptic information delivery. This feature prevents the impediment to natural movements of the skin and ensures the functional integrity of the device during daily deformations of the skin. Finally, three proof‐of‐concept demonstrations illustrate the potential of the reported multimodal haptic devices for advanced haptic interactions across various domains.
- 22 February 2024
- Published by Wiley in Advanced Functional Materials
- Vol. 34 (17)
Multimodal 5‐DOF Stretchable Electromagnetic Actuators toward Haptic Information Delivery
The rapid advancements in artificial intelligence, particularly in the domains of robotics, prosthetics, and virtual and augmented reality (VR/AR), have driven an escalating demand for intuitive and effective human–machine interactions. Consequently, haptic devices, being electronic displays for the sense of touch, have drawn increasing attention. More efforts are in demand to develop stretchable and lightweight haptic devices that can trigger multiple mechanical cutaneous receptors using a single device. This work presents a new 3‐modal 5‐DOF stretchable haptic interface that is enabled by electromagnetic actuators and high‐fidelity multi‐layer metal printing. The haptic device renders rich haptic sensations (i.e., normal force, vibration, angular force, skin dragging) in one device, allowing for the comprehensive delivery of tactile information through the excitation of multiple cutaneous receptors. Additionally, haptic devices are designed to be compact, lightweight, and skin‐compatible. The skin‐like softness and stretchability enable intimate skin contact, which is crucial for efficient haptic information delivery. This feature prevents the impediment to natural movements of the skin and ensures the functional integrity of the device during daily deformations of the skin. Finally, three proof‐of‐concept demonstrations illustrate the potential of the reported multimodal haptic devices for advanced haptic interactions across various domains.
- 21 September 2023
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 10 (12) , 5607-5620
Decoding silent speech commands from articulatory movements through soft magnetic skin and machine learning
This article introduces a wireless, unobtrusive, and robust silent speech interface based on soft magnetic skin and machine learning. The magnetic skin precisely decodes articulatory movements at the temporomandibular joint for speech recognition.
- 21 September 2023
- Published by Royal Society of Chemistry (RSC) in Materials Horizons
- Vol. 10 (12) , 5607-5620
Decoding silent speech commands from articulatory movements through soft magnetic skin and machine learning
This article introduces a wireless, unobtrusive, and robust silent speech interface based on soft magnetic skin and machine learning. The magnetic skin precisely decodes articulatory movements at the temporomandibular joint for speech recognition.
Electromyogram‐Based Lip‐Reading via Unobtrusive Dry Electrodes and Machine Learning Methods
Lip‐reading provides an effective speech communication interface for people with voice disorders and for intuitive human–machine interactions. Existing systems are generally challenged by bulkiness, obtrusiveness, and poor robustness against environmental interferences. The lack of a truly natural and unobtrusive system for converting lip movements to speech precludes the continuous use and wide‐scale deployment of such devices. Here, the design of a hardware–software architecture to capture, analyze, and interpret lip movements associated with either normal or silent speech is presented. The system can recognize different and similar visemes. It is robust in a noisy or dark environment. Self‐adhesive, skin‐conformable, and semi‐transparent dry electrodes are developed to track high‐fidelity speech‐relevant electromyogram signals without impeding daily activities. The resulting skin‐like sensors can form seamless contact with the curvilinear and dynamic surfaces of the skin, which is crucial for a high signal‐to‐noise ratio and minimal interference. Machine learning algorithms are employed to decode electromyogram signals and convert them to spoken words. Finally, the applications of the developed lip‐reading system in augmented reality and medical service are demonstrated, which illustrate the great potential in immersive interaction and healthcare applications.
Electromyogram‐Based Lip‐Reading via Unobtrusive Dry Electrodes and Machine Learning Methods
Lip‐reading provides an effective speech communication interface for people with voice disorders and for intuitive human–machine interactions. Existing systems are generally challenged by bulkiness, obtrusiveness, and poor robustness against environmental interferences. The lack of a truly natural and unobtrusive system for converting lip movements to speech precludes the continuous use and wide‐scale deployment of such devices. Here, the design of a hardware–software architecture to capture, analyze, and interpret lip movements associated with either normal or silent speech is presented. The system can recognize different and similar visemes. It is robust in a noisy or dark environment. Self‐adhesive, skin‐conformable, and semi‐transparent dry electrodes are developed to track high‐fidelity speech‐relevant electromyogram signals without impeding daily activities. The resulting skin‐like sensors can form seamless contact with the curvilinear and dynamic surfaces of the skin, which is crucial for a high signal‐to‐noise ratio and minimal interference. Machine learning algorithms are employed to decode electromyogram signals and convert them to spoken words. Finally, the applications of the developed lip‐reading system in augmented reality and medical service are demonstrated, which illustrate the great potential in immersive interaction and healthcare applications.