PDPenghao Dong

Penghao Dong

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Penghao Dong has a total of 32 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Programming magnetic composites and phase change materials for multimodal haptic interfaces with integrated self-sensing toward adaptive and proprioceptive haptic feedback

    by Si Chen, Su Li, Yizong Li, Penghao Dong, Shanshan Yao

    Enabled by programmable soft magnetic composites, the compact, skin-conformal, self-sensing haptic interface seamlessly delivers three distinct modes of haptic feedback: normal, rotational shear, and skin stretch.


  • Open Access

    MagSkin: Enabling Touchless Human-Computer Interaction with Soft Epidermal Magnetic Material

    by Zeyu Zhang, Hua Huang, Penghao Dong, Shanshan Yao, Shan Lin

    Soft epidermal magnetic material has demonstrated excellent flexibility and wearability across a range of emerging applications, e.g., pressure sensing, robotics, among others. In this paper, we build a flexible magnetic skin based system MagSkin for touchless Human Computer Interaction (HCI). For example, a user can wear a Bandaid-like sticker on his fingertip to operate a smartphone using classic gestures without touching the screen, i.e., tap virtual icons floating on top of the screen. The magnetic skin is specially fabricated with randomly distributed magnetic microparticles, so that any shape change of the skin will cause position and orientation changes of those particles, introducing complex variations of the magnetic field around the skin. To characterize the magnetic field of the magnetic skin, we designed a multi-dipole based model. Based on this model, we developed 6-DoF position tracking and orientation estimation algorithms to localize the skin precisely. We also designed novel gestures, e.g., finger bend and pinch, for users to make input/adjustment based on the flexibility of the material. We have conducted experiments with 15 volunteers for 18 hours, experimental results show localization accuracy is 6.2 mm in 3D, 4.5 mm in 2D, and recognition accuracy is 94% for classical gesture and 92% for novel gesture.


  • Unobtrusive Swallow Monitoring Enabled by Conformal IONOGEL Biopotential Electrodes and Machine Learning

    by Penghao Dong, Jasmine Ives, Ethan Garcia, Christopher Caporusso, Polina Bragina, Cassandra Laguatan, Shanshan Yao

    Dysphagia or difficulty swallowing is caused by the failure of neurological pathways to properly activate swallowing muscles. Current electromyography (EMG) systems for dysphagia monitoring are bulky and rigid, limiting their potential for long‐term and unobtrusive use. To address this, a machine learning‐assisted wearable EMG system is presented, utilizing self‐adhesive, skin‐conformal, semi‐transparent, and robust ionic gel electrodes. The presented electrodes possess good conductivity, superior skin contact, and good transmittance, ensuring high‐fidelity EMG sensing without impeding daily activities. Moreover, the optimized material and structural designs ensure wearing comfort and conformable skin‐electrode contact, allowing for long‐term monitoring with high accuracy. Machine learning and mel‐frequency cepstral coefficient techniques are employed to classify swallowing events based on food types and volumes. Through an analysis of electrode placement on the chin and neck, the proposed system is able to effectively distinguish between different food types and water volumes using a small number of channels, making it suitable for continuous dysphagia monitoring. This work represents an advancement in machine learning assisted EMG systems for the classification and regression of swallowing events, paving the way for more efficient, unobtrusive, and long‐term dysphagia monitoring systems.


  • Thermally responsive spatially programmable soft actuators with multiple response states enabled by Grayscale UV light processing

    by Yizong Li, Sooyeon Noh Coodley, Si Chen, Penghao Dong, Su Li, Shanshan Yao

    This work presents a scalable grayscale UV technique for fabricating spatially programmable soft actuators with diverse actuation behaviors in one actuator. The advanced programmability lays the foundation for soft robotics and adaptive devices.


  • Decoding Silent Speech Cues From Muscular Biopotential Signals for Efficient Human‐Robot Collaborations

    by Penghao Dong, Sibo Tian, Si Chen, Yizong Li, Su Li, Minghui Zheng, Shanshan Yao

    Silent speech interfaces offer an alternative and efficient communication modality for individuals with voice disorders and when the vocalized speech communication is compromised by noisy environments. Despite the recent progress in developing silent speech interfaces, these systems face several challenges that prevent their wide acceptance, such as bulkiness, obtrusiveness, and immobility. Herein, the material optimization, structural design, deep learning algorithm, and system integration of mechanically and visually unobtrusive silent speech interfaces are presented that can realize both speaker identification and speech content identification. Conformal, transparent, and self‐adhesive electromyography electrode arrays are designed for capturing speech‐relevant muscle activities. Temporal convolutional networks are employed for recognizing speakers and converting sensing signals into spoken content. The resulting silent speech interfaces achieve a 97.5% speaker classification accuracy and 91.5% keyword classification accuracy using four electrodes. The speech interface is further integrated with an optical hand‐tracking system and a robotic manipulator for human‐robot collaboration in both assembly and disassembly processes. The integrated system achieves the control of the robot manipulator by silent speech and facilitates the hand‐over process by hand motion trajectory detection. The developed framework enables natural robot control in noisy environments and lays the ground for collaborative human‐robot tasks involving multiple human operators.


  • Multimodal 5‐DOF Stretchable Electromagnetic Actuators toward Haptic Information Delivery

    by Si Chen, Li Yu, Weijun Shen, Brian Fong, Yizong Li, Penghao Dong, Hantang Qin, Shanshan Yao

    The rapid advancements in artificial intelligence, particularly in the domains of robotics, prosthetics, and virtual and augmented reality (VR/AR), have driven an escalating demand for intuitive and effective human–machine interactions. Consequently, haptic devices, being electronic displays for the sense of touch, have drawn increasing attention. More efforts are in demand to develop stretchable and lightweight haptic devices that can trigger multiple mechanical cutaneous receptors using a single device. This work presents a new 3‐modal 5‐DOF stretchable haptic interface that is enabled by electromagnetic actuators and high‐fidelity multi‐layer metal printing. The haptic device renders rich haptic sensations (i.e., normal force, vibration, angular force, skin dragging) in one device, allowing for the comprehensive delivery of tactile information through the excitation of multiple cutaneous receptors. Additionally, haptic devices are designed to be compact, lightweight, and skin‐compatible. The skin‐like softness and stretchability enable intimate skin contact, which is crucial for efficient haptic information delivery. This feature prevents the impediment to natural movements of the skin and ensures the functional integrity of the device during daily deformations of the skin. Finally, three proof‐of‐concept demonstrations illustrate the potential of the reported multimodal haptic devices for advanced haptic interactions across various domains.


  • Decoding silent speech commands from articulatory movements through soft magnetic skin and machine learning

    by Penghao Dong, Yizong Li, Si Chen, Justin T. Grafstein, Irfaan Khan, Shanshan Yao

    This article introduces a wireless, unobtrusive, and robust silent speech interface based on soft magnetic skin and machine learning. The magnetic skin precisely decodes articulatory movements at the temporomandibular joint for speech recognition.


  • Electromyogram‐Based Lip‐Reading via Unobtrusive Dry Electrodes and Machine Learning Methods

    by Penghao Dong, Yuanqing Song, Shangyouqiao Yu, Zimeng Zhang, Sandeep K. Mallipattu, Petar M. Djurić, Shanshan Yao

    Lip‐reading provides an effective speech communication interface for people with voice disorders and for intuitive human–machine interactions. Existing systems are generally challenged by bulkiness, obtrusiveness, and poor robustness against environmental interferences. The lack of a truly natural and unobtrusive system for converting lip movements to speech precludes the continuous use and wide‐scale deployment of such devices. Here, the design of a hardware–software architecture to capture, analyze, and interpret lip movements associated with either normal or silent speech is presented. The system can recognize different and similar visemes. It is robust in a noisy or dark environment. Self‐adhesive, skin‐conformable, and semi‐transparent dry electrodes are developed to track high‐fidelity speech‐relevant electromyogram signals without impeding daily activities. The resulting skin‐like sensors can form seamless contact with the curvilinear and dynamic surfaces of the skin, which is crucial for a high signal‐to‐noise ratio and minimal interference. Machine learning algorithms are employed to decode electromyogram signals and convert them to spoken words. Finally, the applications of the developed lip‐reading system in augmented reality and medical service are demonstrated, which illustrate the great potential in immersive interaction and healthcare applications.