A Flexible Bidirectional Interface with Integrated Multimodal Sensing and Haptic Feedback for Closed‐Loop Human–Machine Interaction
Authors:
Open Access
- 1 September 2023
- journal article
- research article
- Published by Wiley in Advanced Intelligent Systems
- Vol. 5 (11)
Abstract
Human–machine interaction (HMI) establishes an interconnected bridge between humans and robots and plays a significant role in industry and medical fields. However, the conventional interface is bulky and rigid with a single function. It lacks feedback information to be provided to the user, limiting its application scenarios and the ability to complete complex tasks in a dynamic environment. Herein, a flexible bidirectional (FBD) interface with integrated multimodal sensing and haptic feedback and the development of an FBD‐based closed‐loop HMI platform are presented. The proposed FBD interface offers programmable haptic feedback through a coin vibration motor array to endow the user with better performance in missions. The multimodal sensing array can perceive signals of joint movement and the pressure imposed on the skin. In addition, the FBD interface exhibits significant advantages of flexibility and a compact structure. The experimental tests verify that the multimodal sensing module can accurately perceive various static and dynamic movements of a human. Furthermore, the actuation module can provide diverse haptic vibrations to convey different information to the user. Moreover, successful applications in the scenarios of bilateral robotic teleoperation and assistance of disabled people indicate great potential of the FBD interface for broad applications.Keywords
Funding Information
- National Natural Science Foundation of China (52175556)
- Fundo para o Desenvolvimento das Ciências e da Tecnologia (0102/2022/A2, 0004/2022/AKP)
This publication has 57 references indexed in Scilit:
- Classification of multichannel surface-electromyography signals based on convolutional neural networksJournal of Industrial Information Integration, 2019
- Self-powered glove-based intuitive interface for diversified control applications in real/cyber spaceNano Energy, 2019
- A 7-DOF redundantly actuated parallel haptic device combining 6-DOF manipulation and 1-DOF graspingMechanism and Machine Theory, 2019
- Exploiting Textile Mechanical Anisotropy for Fabric-Based Pneumatic ActuatorsSoft Robotics, 2018
- Programmable Deformations of Networked Inflated Dielectric Elastomer ActuatorsIEEE/ASME Transactions on Mechatronics, 2018
- Computer vision and deep learning techniques for pedestrian detection and tracking: A surveyNeurocomputing, 2018
- Accuracy of human motion capture systems for sport applications; state‐of‐the‐art reviewEuropean Journal of Sport Science, 2018
- Miniature Soft Electromagnetic Actuators for Robotic ApplicationsAdvanced Functional Materials, 2018
- Thin, Soft, Skin‐Mounted Microfluidic Networks with Capillary Bursting Valves for Chrono‐Sampling of SweatAdvanced Healthcare Materials, 2017
- A soft, wearable microfluidic device for the capture, storage, and colorimetric sensing of sweatScience Translational Medicine, 2016