Hankai Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hankai Liu has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Yongtao Ma
School of Microelectronics, Tianjin Key Laboratory of Imaging and Sensing Microelectronic Technology, and Tianjin Digital Information Technology Research Center, Tianjin University, Tianjin, China
11 shared publications - Xin Xie
Tianjin University
6 shared publications - Xiulong Liu
Tianjin University, Tianjin, China
6 shared publications - Keqiu Li
Tianjin University
5 shared publications - Chenglong Tian
Tsinghua University
4 shared publications - Xinyu Tong
Tianjin University
4 shared publications
Latest Publications
- 11 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (9) , 9168-9183
MHTrack: mmWave-Based Mobile Hand Tracking
Non-intrusive hand tracking with mmWave radar technology is important in various Human-Computer Interaction (HCI) scenarios. However, existing mmWave-based solutions require users to be stationary and restrict a fixed hand motion area, which limits application flexibility and user experience. This paper proposes a novel mmWave-based Mobile Hand Tracking (MHTrack) system, which tracks user’s hand gestures during walking. MHTrack focuses on tracking both absolute hand trajectory in the global coordinate system and relative hand trajectory to the body. Specifically, we propose a wake-up mechanism for hand motion capture, in which hand point cloud can be recognized even under body interference and noise. We propose a hand tracking strategy named local spatial update, which overcomes the sparsity and instability of point clouds, to obtain absolute hand trajectory. Subsequently, we propose a hand anchor correction method to suppress anchor offset and remove the impact of body movement from absolute hand trajectory, thereby obtaining relative hand trajectory. As a case study, we project the relative hand trajectory onto a 2D image and feed it into a gesture recognition model to recognize the gestures. We conduct extensive experiments to evaluate the performance of MHTrack. Results demonstrate a 3D hand trajectory tracking error of$ 3.6$ cm in an area of$ 3.2\;{\rm m}\,\times\, 4.8\;{\rm m}$ and a gesture recognition accuracy of 99% with 30 gesture classes.- 11 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (9) , 9168-9183
MHTrack: mmWave-Based Mobile Hand Tracking
Non-intrusive hand tracking with mmWave radar technology is important in various Human-Computer Interaction (HCI) scenarios. However, existing mmWave-based solutions require users to be stationary and restrict a fixed hand motion area, which limits application flexibility and user experience. This paper proposes a novel mmWave-based Mobile Hand Tracking (MHTrack) system, which tracks user’s hand gestures during walking. MHTrack focuses on tracking both absolute hand trajectory in the global coordinate system and relative hand trajectory to the body. Specifically, we propose a wake-up mechanism for hand motion capture, in which hand point cloud can be recognized even under body interference and noise. We propose a hand tracking strategy named local spatial update, which overcomes the sparsity and instability of point clouds, to obtain absolute hand trajectory. Subsequently, we propose a hand anchor correction method to suppress anchor offset and remove the impact of body movement from absolute hand trajectory, thereby obtaining relative hand trajectory. As a case study, we project the relative hand trajectory onto a 2D image and feed it into a gesture recognition model to recognize the gestures. We conduct extensive experiments to evaluate the performance of MHTrack. Results demonstrate a 3D hand trajectory tracking error of$ 3.6$ cm in an area of$ 3.2\;{\rm m}\,\times\, 4.8\;{\rm m}$ and a gesture recognition accuracy of 99% with 30 gesture classes.- 1 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (9) , 8347-8361
Multi-User Behavioral Privacy Filtering for mmWave Radar Sensing
As an advanced technology for non-contact sensing, mmWave radar enables fine-grained measurement of a wide variety of user behaviors. While creating intelligence and convenience, it also concerns behavioral privacy and security, as radar signals contain a wealth of behavioral information. Existing solutions are either incapable of customizable privacy protections or cannot cope with multi-person scenarios. This paper presents a Multi-user behavioral privacy Filter, MuFilter, a data masking system centered on the idea of dimensional signal interference. It determines the sensing signatures that need to be preserved or interfered with based on the sensing services that users want to enable and disable, thereby making targeted tampering on the radar signal. On this basis, we introduce the multi-person tracking technology to allow MuFilter to determine the number of users in unknown scenarios. Moreover, a subspace tampering technique is proposed to ensure that each tampering only affects the target user and not other users, thus supporting personalized privacy protection for multiple users. Experiments show that MuFilter can interfere with targeted behavioral signatures with a 100% success rate, while the degree of impact on other users’ signatures ranges from 0% to 3.85%.
- 1 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (9) , 8347-8361
Multi-User Behavioral Privacy Filtering for mmWave Radar Sensing
As an advanced technology for non-contact sensing, mmWave radar enables fine-grained measurement of a wide variety of user behaviors. While creating intelligence and convenience, it also concerns behavioral privacy and security, as radar signals contain a wealth of behavioral information. Existing solutions are either incapable of customizable privacy protections or cannot cope with multi-person scenarios. This paper presents a Multi-user behavioral privacy Filter, MuFilter, a data masking system centered on the idea of dimensional signal interference. It determines the sensing signatures that need to be preserved or interfered with based on the sensing services that users want to enable and disable, thereby making targeted tampering on the radar signal. On this basis, we introduce the multi-person tracking technology to allow MuFilter to determine the number of users in unknown scenarios. Moreover, a subspace tampering technique is proposed to ensure that each tampering only affects the target user and not other users, thus supporting personalized privacy protection for multiple users. Experiments show that MuFilter can interfere with targeted behavioral signatures with a 100% success rate, while the degree of impact on other users’ signatures ranges from 0% to 3.85%.
- 19 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (7) , 7888-7901
Enhancing Noncontact Vibration Monitoring With mmWave Radar and Camera Fusion
Automated manufacturing is the cornerstone of the Industrial Internet-of-Things (IIoT) ecosystem, where vibration monitoring technology is a critical tool for maintaining industrial machinery. The prevailing approach mostly employs Inertial Measurement Units (IMUs), lasers, and cameras, each demonstrating deployment constraints. In recent years, millimeter-wave (mmWave) radar has shown high vibration measurement performance, but it faces challenges in accurately localizing vibrating objects and determining observation points. This study introduces a new system called VibCamera, which leverages mmWave vibration measurement technology with computer vision (CV) algorithms for vibration monitoring. With the positional assistant of CV semantic segmentation, the radar can accurately determine sufficient observation points, thereby achieving precise measurement with high directionality. VibCamera includes two camera modes, RGB-only and RGB+depth, and solves two technical challenges: integrating multimodal information for vibration target localization and extracting high-quality vibration signals in interference environments. VibCamera provides more consistent and precise outcomes without the need for physical contact. The experimental results indicate that the RGB-only mode has amplitude and frequency errors below 27.04μm and 0.22Hz, respectively, with a 90% probability, and the RGB+depth mode has errors below 23.72μm and 0.21Hz.
- 19 December 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (7) , 7888-7901
Enhancing Noncontact Vibration Monitoring With mmWave Radar and Camera Fusion
Automated manufacturing is the cornerstone of the Industrial Internet-of-Things (IIoT) ecosystem, where vibration monitoring technology is a critical tool for maintaining industrial machinery. The prevailing approach mostly employs Inertial Measurement Units (IMUs), lasers, and cameras, each demonstrating deployment constraints. In recent years, millimeter-wave (mmWave) radar has shown high vibration measurement performance, but it faces challenges in accurately localizing vibrating objects and determining observation points. This study introduces a new system called VibCamera, which leverages mmWave vibration measurement technology with computer vision (CV) algorithms for vibration monitoring. With the positional assistant of CV semantic segmentation, the radar can accurately determine sufficient observation points, thereby achieving precise measurement with high directionality. VibCamera includes two camera modes, RGB-only and RGB+depth, and solves two technical challenges: integrating multimodal information for vibration target localization and extracting high-quality vibration signals in interference environments. VibCamera provides more consistent and precise outcomes without the need for physical contact. The experimental results indicate that the RGB-only mode has amplitude and frequency errors below 27.04μm and 0.22Hz, respectively, with a 90% probability, and the RGB+depth mode has errors below 23.72μm and 0.21Hz.
- 26 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (12) , 18271-18285
A Synthetic Aperture Scheme for Integrated Localization and Navigation in Passive IoT
In passive Internet of Things, existing synthetic aperture-based 3D localization methods face many challenges, such as high computational load, a large aperture of a virtual antenna array, and sensitivity to noise. To address these challenges, this paper develops a synthetic aperture scheme for integrated localization and navigation, which implements the localization algorithm with a trajectory generated by the navigation algorithm. The localization problem is formulated by multidimensional scaling, which exploits phase differences involving the spatial information between target tags and a virtual antenna array. The new formulation allows the system to provide an accurate location estimate with a large moving step and sparse virtual antenna array of narrow apertures. The navigation problem is formulated to decrease errors of distance differences. Moreover, a navigation criterion is established to determine the feasibility of a virtual antenna position based on phase measurements, and an efficient navigation algorithm is proposed to find such a feasible point. Extensive numerical results validate our theoretical analysis and the performance of the proposed scheme.
- 26 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (12) , 18271-18285
A Synthetic Aperture Scheme for Integrated Localization and Navigation in Passive IoT
In passive Internet of Things, existing synthetic aperture-based 3D localization methods face many challenges, such as high computational load, a large aperture of a virtual antenna array, and sensitivity to noise. To address these challenges, this paper develops a synthetic aperture scheme for integrated localization and navigation, which implements the localization algorithm with a trajectory generated by the navigation algorithm. The localization problem is formulated by multidimensional scaling, which exploits phase differences involving the spatial information between target tags and a virtual antenna array. The new formulation allows the system to provide an accurate location estimate with a large moving step and sparse virtual antenna array of narrow apertures. The navigation problem is formulated to decrease errors of distance differences. Moreover, a navigation criterion is established to determine the feasibility of a virtual antenna position based on phase measurements, and an efficient navigation algorithm is proposed to find such a feasible point. Extensive numerical results validate our theoretical analysis and the performance of the proposed scheme.
- Open Access
- 19 December 2023
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 7 (4) , 1-30
PmTrack
The difficulty in obtaining targets' identity poses a significant obstacle to the pursuit of personalized and customized millimeter-wave (mmWave) sensing. Existing solutions that learn individual differences from signal features have limitations in practical applications. This paper presents a Personalized mmWave-based human Tracking system, PmTrack, by introducing inertial measurement units (IMUs) as identity indicators. Widely available in portable devices such as smartwatches and smartphones, IMUs utilize existing wireless networks for data uploading of identity and data, and are therefore able to assist in radar target identification in a lightweight manner with little deployment and carrying burden for users. PmTrack innovatively adopts orientation as the matching feature, thus well overcoming the data heterogeneity between radar and IMU while avoiding the effect of cumulative errors. In the implementation of PmTrack, we propose a comprehensive set of optimization methods in detection enhancement, interference suppression, continuity maintenance, and trajectory correction, which successfully solved a series of practical problems caused by the three major challenges of weak reflection, point cloud overlap, and body-bounce ghost in multi-person tracking. In addition, an orientation correction method is proposed to overcome the IMU gimbal lock. Extensive experimental results demonstrate that PmTrack achieves an identification accuracy of 98% and 95% with five people in the hall and meeting room, respectively.
- 19 December 2023
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 7 (4) , 1-30
Open AccessPmTrack
The difficulty in obtaining targets' identity poses a significant obstacle to the pursuit of personalized and customized millimeter-wave (mmWave) sensing. Existing solutions that learn individual differences from signal features have limitations in practical applications. This paper presents a Personalized mmWave-based human Tracking system, PmTrack, by introducing inertial measurement units (IMUs) as identity indicators. Widely available in portable devices such as smartwatches and smartphones, IMUs utilize existing wireless networks for data uploading of identity and data, and are therefore able to assist in radar target identification in a lightweight manner with little deployment and carrying burden for users. PmTrack innovatively adopts orientation as the matching feature, thus well overcoming the data heterogeneity between radar and IMU while avoiding the effect of cumulative errors. In the implementation of PmTrack, we propose a comprehensive set of optimization methods in detection enhancement, interference suppression, continuity maintenance, and trajectory correction, which successfully solved a series of practical problems caused by the three major challenges of weak reflection, point cloud overlap, and body-bounce ghost in multi-person tracking. In addition, an orientation correction method is proposed to overcome the IMU gimbal lock. Extensive experimental results demonstrate that PmTrack achieves an identification accuracy of 98% and 95% with five people in the hall and meeting room, respectively.
- 31 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (7) , 11175-11189
PosMonitor: Fine-Grained Sleep Posture Recognition With mmWave Radar
Sleep posture recognition is practically important in various scenarios such as sleep healthcare, bedridden patient care, and chronic disease diagnosis. With concerns of user privacy preserving, we prefer the wireless sensing methods to computer vision methods when dealing with sleep posture recognition. However, the existing wireless sensing methods suffer from at least one of the following major limitations: (i) difficult to deploy in practice; (ii) few posture categories; (iii) insufficient accuracy; (iv) poor generalization ability. In this paper, we use commercial-off-the-shelf (COTS) mmWave radar to implement a sleep posture recognition system called PosMonitor. When designing the PosMonitor system, we need to address the following challenging issues. First, we propose an angle purification method based on multi-frame joint analysis to alleviate the sparsity and instability of the point cloud. Then, we endow the point cloud with respiratory features to enhance its representation of the sleep posture. Further, to make the system applicable to different users, we extract relative respiratory features by normalization to overcome individual differences. Extensive experimental results show that our PosMonitor system can achieve 98% accuracy on average in recognizing 6 typical sleep postures and has good reliability across different conditions.
- 31 October 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (7) , 11175-11189
PosMonitor: Fine-Grained Sleep Posture Recognition With mmWave Radar
Sleep posture recognition is practically important in various scenarios such as sleep healthcare, bedridden patient care, and chronic disease diagnosis. With concerns of user privacy preserving, we prefer the wireless sensing methods to computer vision methods when dealing with sleep posture recognition. However, the existing wireless sensing methods suffer from at least one of the following major limitations: (i) difficult to deploy in practice; (ii) few posture categories; (iii) insufficient accuracy; (iv) poor generalization ability. In this paper, we use commercial-off-the-shelf (COTS) mmWave radar to implement a sleep posture recognition system called PosMonitor. When designing the PosMonitor system, we need to address the following challenging issues. First, we propose an angle purification method based on multi-frame joint analysis to alleviate the sparsity and instability of the point cloud. Then, we endow the point cloud with respiratory features to enhance its representation of the sleep posture. Further, to make the system applicable to different users, we extract relative respiratory features by normalization to overcome individual differences. Extensive experimental results show that our PosMonitor system can achieve 98% accuracy on average in recognizing 6 typical sleep postures and has good reliability across different conditions.
- 18 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (7) , 9688
Corrections to “Crucial or Unnecessary? Analysis on Phase Differential in Holographic SAR RFID Localization”
Presents corrections to the paper, Crucial or Unnecessary? Analysis on Phase Differential in Holographic SAR RFID Localization.
- 18 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (7) , 9688
Corrections to “Crucial or Unnecessary? Analysis on Phase Differential in Holographic SAR RFID Localization”
Presents corrections to the paper, Crucial or Unnecessary? Analysis on Phase Differential in Holographic SAR RFID Localization.
- 17 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-13
Trajectory-Robust RFID Relative Localization Based on Phase Profile Correlation
Indoor localization systems based on radio frequency identification (RFID) technologies are widely adopted in the Internet of Things (IoT). Many of these applications prefer to obtain the relative position of the target object rather than the absolute position. Existing relative positioning methods are subject to strict trajectory constraints and cannot work under non-straight trajectories. RFID mobile localization which has high accuracy can also be utilized for relative positioning, but they require the acquisition of precise moving trajectory coordinates. To overcome these challenges, we propose a moving relative localization algorithm, TRL, based on phase profiles correlation in this paper. The intuition of TRL is that the phase of the backscattered signal has a linear mapping relationship with the distance between the reader and the antenna, so the closer the tag is to each other, the higher the correlation of their phase curves is. We use the dynamic time warping (DTW) algorithm to calculate the correlation between the phase profiles of different tags and achieve relative localization of all tags by sequentially determining their position intervals in the tag sequence. Compared to state-of-the-art solutions, TRL gives greater flexibility to antenna movement and the demand for trajectory coordinates, and is fully robust to trajectory error. A series of experimental results show that TRL has significant advantages over current state-of-the-art schemes in terms of both accuracy and computation time.
- 17 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-13
Trajectory-Robust RFID Relative Localization Based on Phase Profile Correlation
Indoor localization systems based on radio frequency identification (RFID) technologies are widely adopted in the Internet of Things (IoT). Many of these applications prefer to obtain the relative position of the target object rather than the absolute position. Existing relative positioning methods are subject to strict trajectory constraints and cannot work under non-straight trajectories. RFID mobile localization which has high accuracy can also be utilized for relative positioning, but they require the acquisition of precise moving trajectory coordinates. To overcome these challenges, we propose a moving relative localization algorithm, TRL, based on phase profiles correlation in this paper. The intuition of TRL is that the phase of the backscattered signal has a linear mapping relationship with the distance between the reader and the antenna, so the closer the tag is to each other, the higher the correlation of their phase curves is. We use the dynamic time warping (DTW) algorithm to calculate the correlation between the phase profiles of different tags and achieve relative localization of all tags by sequentially determining their position intervals in the tag sequence. Compared to state-of-the-art solutions, TRL gives greater flexibility to antenna movement and the demand for trajectory coordinates, and is fully robust to trajectory error. A series of experimental results show that TRL has significant advantages over current state-of-the-art schemes in terms of both accuracy and computation time.
- 20 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (1) , 1265-1278
RAPP: A Radio Tomography Localization Method Characterized by Performance Parameterization in Rapid-Moving RFID System
Exploring and developing the perception system is an important means to promote the development of intelligent transportation. In this paper, we propose RAPP, a radio tomography-based method enabling performance parameterization to achieve parameter adjustment of localization accuracy without dense deployment of passive UHF RFID devices. The reader antenna takes a rapid-moving system as the carrier and generates virtual antenna elements to inventory received signal strength (RSS) of the pre-deployed tags. To eliminate the impact of the lack of tag backward signals during the mobile process and supplement the link distribution for each segment of the monitored platform, the Cubic Spline Interpolation algorithm (CSIA) is proposed to homogenize the spacing of the virtual antenna elements by preprocessing the measurements. Then the optimized link information is adopted to perform radio tomographic imaging to recognize the locations of targets. Theoretical analysis on ill-condition is derived to analyze how the number of virtual interpolation elements affects the localization accuracy. Further derivation about the relationship between the Bayesian Cramér-Rao Bound (CRB) and the link density provides a solution to influence the localization performance through parameter adjustment. Extensive simulation and experiment show that RAPP outperforms on multiple targets localization and behaves robustly in a multipath environment.
- 20 September 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 72 (1) , 1265-1278
RAPP: A Radio Tomography Localization Method Characterized by Performance Parameterization in Rapid-Moving RFID System
Exploring and developing the perception system is an important means to promote the development of intelligent transportation. In this paper, we propose RAPP, a radio tomography-based method enabling performance parameterization to achieve parameter adjustment of localization accuracy without dense deployment of passive UHF RFID devices. The reader antenna takes a rapid-moving system as the carrier and generates virtual antenna elements to inventory received signal strength (RSS) of the pre-deployed tags. To eliminate the impact of the lack of tag backward signals during the mobile process and supplement the link distribution for each segment of the monitored platform, the Cubic Spline Interpolation algorithm (CSIA) is proposed to homogenize the spacing of the virtual antenna elements by preprocessing the measurements. Then the optimized link information is adopted to perform radio tomographic imaging to recognize the locations of targets. Theoretical analysis on ill-condition is derived to analyze how the number of virtual interpolation elements affects the localization accuracy. Further derivation about the relationship between the Bayesian Cramér-Rao Bound (CRB) and the link density provides a solution to influence the localization performance through parameter adjustment. Extensive simulation and experiment show that RAPP outperforms on multiple targets localization and behaves robustly in a multipath environment.