Hand-Finger Pose Estimation Using Inertial Sensors, Magnetic Sensors and a Magnet
- 3 June 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (16) , 18115-18122
Abstract
Hand-finger motion tracking based on inertial and magnetic measurement units (IMMUs) has become a well-accepted method in many applications such as rehabilitation and virtual reality. However, existing systems require an IMMU on each segment of the whole hand and known length of each segment, which is hard to achieve for users. Therefore, we proposed a small sensor configuration with three IMMUs and a magnet to estimate poses of interested fingertips relative to the hand. The relative orientations were estimated by integrating relative angular velocity and fused with relative orientation estimation during time intervals when the whole hand moved or rotated as one object. The relative positions were estimated by using a magnetic dipole model of the magnet and prior estimated relative orientations. The performance has been demonstrated in multiple experiments. For whole hand rotation and functional grasping or writing experiments, the estimated errors of index fingertip position and orientation relative to the hand were 8.0~9.8 mm and 5.7° ~11.2°. For index finger flexion and pinching, the estimated errors of index fingertip position and orientation relative to the hand were 16.2~25.2 mm and 20.6° ~ 21.7°.Keywords
Funding Information
- China Scholarship Council
This publication has 27 references indexed in Scilit:
- A Quaternion-Based Unscented Kalman Filter for Robust Optical/Inertial Motion Tracking in Computer-Assisted SurgeryIEEE Transactions on Instrumentation and Measurement, 2015
- Ambulatory Estimation of Relative Foot Positions by Fusing Ultrasound and Inertial Sensor DataIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014
- Hand Pose Estimation by Fusion of Inertial and Magnetic Sensing Aided by a Permanent MagnetIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2014
- Comparative abilities of Microsoft Kinect and Vicon 3D motion capture for gait analysisJournal of Medical Engineering & Technology, 2014
- Assessment of hand kinematics using inertial and magnetic sensorsJournal of NeuroEngineering and Rehabilitation, 2014
- Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb RehabilitationIEEE Transactions on Biomedical Engineering, 2013
- Ambulatory human motion tracking by fusion of inertial and magnetic sensing with adaptive actuationMedical & Biological Engineering & Computing, 2009
- Localization and magnetic moment estimation of a ferromagnetic target by simulated annealingMeasurement Science and Technology, 2007
- Repeatability of 3D gait kinematics obtained from an electromagnetic tracking system during treadmill locomotionJournal of Biomechanics, 2007
- Evaluation of a new electromagnetic tracking system using a standardized assessment protocolPhysics in Medicine & Biology, 2006