Huakun Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Huakun Liu has a total of 68 co-authors. Here are the top co-authors by number of shared publications:
- Hideaki Uchiyama
Cybernetics and Reality Engineering Laboratory, Nara Institute of Science and Technology, Ikoma, Nara, Japan
8 shared publications - Kiyoshi Kiyokawa
Cybernetics and Reality Engineering Laboratory, Nara Institute of Science and Technology, Ikoma, Nara, Japan
7 shared publications - Monica Perusquía-Hernández
Cybernetics and Reality Engineering Laboratory, Nara Institute of Science and Technology, Ikoma, Nara, Japan
6 shared publications - Xin Wei
Cybernetics and Reality Engineering Laboratory, Nara Institute of Science and Technology, Ikoma, Nara, Japan
6 shared publications - Felix Dollack
Nara Institute of Science and Technology
3 shared publications - Chirag Raman
Delft University of Technology
2 shared publications
Latest Publications
- 10 September 2026
- Published by Springer Nature
- p. 509-527
ARMS: Anchor–Relational Motion Streaming for Seamless Solo-Social Motion Transitions
- 10 September 2026
- Published by Springer Nature
- p. 509-527
ARMS: Anchor–Relational Motion Streaming for Seamless Solo-Social Motion Transitions
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. PP (21682194) , 1-15
Electrooculography-Based Detection of Refractive Vision Problems
Early detection of visual impairments remains a persistent challenge, especially due to the subtle and often unnoticed nature of early-stage symptoms. Recent works have attempted to transition clinical tests to home-based services or develop innovative diagnostic methods, but most approaches remain self-initiated and discrete. In this study, we focused on refractive disorders and explored the feasibility of using electrooculography (EOG) to detect changes in refractive power passively. Thirty-nine participants used optometry trial lenses to simulate different refractive conditions. Participants performed a series of visual tasks while their EOG signals were recorded. We trained classification models to predict simulated refractive power levels relative to baseline visual condition across multiple evaluation settings, including within-subject, temporal generalization, and across-subject scenarios. The findings reveal that refractive power classification models achieve a mean accuracy of $0.950 \pm 0.034$ in within-subject, within-condition scenarios. Within-subject models tested on data from a different time point showed highly variable performance. While some participants achieved promising results, overall accuracy remained low, with a mean of $0.159 \pm 0.285$. We employed three strategies to evaluate the across-subject models. Naive models performed poorly ($0.161 \pm 0.063$) and linear normalization provided limited improvement ($0.175 \pm 0.062$). However, the fine-tuning strategy substantially improved the model's performance ($0.785 \pm 0.123$). EOG signals contain useful information for refractive power classification, particularly in personalized contexts. However, generalizing across time and individuals remains challenging. Overall, this work offers valuable insights for advancing EOG-based systems aimed at passive, real-time monitoring of visual conditions.
- 12 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. PP (21682194) , 1-15
Electrooculography-Based Detection of Refractive Vision Problems
Early detection of visual impairments remains a persistent challenge, especially due to the subtle and often unnoticed nature of early-stage symptoms. Recent works have attempted to transition clinical tests to home-based services or develop innovative diagnostic methods, but most approaches remain self-initiated and discrete. In this study, we focused on refractive disorders and explored the feasibility of using electrooculography (EOG) to detect changes in refractive power passively. Thirty-nine participants used optometry trial lenses to simulate different refractive conditions. Participants performed a series of visual tasks while their EOG signals were recorded. We trained classification models to predict simulated refractive power levels relative to baseline visual condition across multiple evaluation settings, including within-subject, temporal generalization, and across-subject scenarios. The findings reveal that refractive power classification models achieve a mean accuracy of $0.950 \pm 0.034$ in within-subject, within-condition scenarios. Within-subject models tested on data from a different time point showed highly variable performance. While some participants achieved promising results, overall accuracy remained low, with a mean of $0.159 \pm 0.285$. We employed three strategies to evaluate the across-subject models. Naive models performed poorly ($0.161 \pm 0.063$) and linear normalization provided limited improvement ($0.175 \pm 0.062$). However, the fine-tuning strategy substantially improved the model's performance ($0.785 \pm 0.123$). EOG signals contain useful information for refractive power classification, particularly in personalized contexts. However, generalizing across time and individuals remains challenging. Overall, this work offers valuable insights for advancing EOG-based systems aimed at passive, real-time monitoring of visual conditions.
- Open Access
- 30 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 414-426
Mind Your Vision: A Passive Multimodal Framework for Refractive Disorders Measurement Combining Electrooculography and Eye Tracking
- 30 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 414-426
Open AccessMind Your Vision: A Passive Multimodal Framework for Refractive Disorders Measurement Combining Electrooculography and Eye Tracking
- Open Access
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 7-11
Large Language Models as Perceivers of Dynamic Full-Body Expressions of Emotion
- 12 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 7-11
Open AccessLarge Language Models as Perceivers of Dynamic Full-Body Expressions of Emotion
- Open Access
- 25 June 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (6)
Big team science reveals promises and limitations of machine learning efforts to model physiological markers of affective experience
Researchers are increasingly using machine learning to study physiological markers of emotion. We evaluated the promises and limitations of this approach via a big team science competition. Twelve teams competed to predict self-reported affective experiences using a multi-modal set of peripheral nervous system measures. Models were trained and tested in multiple ways: with data divided by participants, targeted emotion, inductions, and time. In 100% of tests, teams outperformed baseline models that made random predictions. In 46% of tests, teams also outperformed baseline models that relied on the simple average of ratings from training datasets. More notably, results uncovered a methodological challenge: multiplicative constraints on generalizability. Inferences about the accuracy and theoretical implications of machine learning efforts depended not only on their architecture, but also how they were trained, tested, and evaluated. For example, some teams performed better when tested on observations from the same (vs. different) subjects seen during training. Such results could be interpreted as evidence against claims of universality. However, such conclusions would be premature because other teams exhibited the opposite pattern. Taken together, results illustrate how big team science can be leveraged to understand the promises and limitations of machine learning methods in affective science and beyond.
- 25 June 2025
- Published by The Royal Society in Royal Society Open Science
- Vol. 12 (6)
Open AccessBig team science reveals promises and limitations of machine learning efforts to model physiological markers of affective experience
Researchers are increasingly using machine learning to study physiological markers of emotion. We evaluated the promises and limitations of this approach via a big team science competition. Twelve teams competed to predict self-reported affective experiences using a multi-modal set of peripheral nervous system measures. Models were trained and tested in multiple ways: with data divided by participants, targeted emotion, inductions, and time. In 100% of tests, teams outperformed baseline models that made random predictions. In 46% of tests, teams also outperformed baseline models that relied on the simple average of ratings from training datasets. More notably, results uncovered a methodological challenge: multiplicative constraints on generalizability. Inferences about the accuracy and theoretical implications of machine learning efforts depended not only on their architecture, but also how they were trained, tested, and evaluated. For example, some teams performed better when tested on observations from the same (vs. different) subjects seen during training. Such results could be interpreted as evidence against claims of universality. However, such conclusions would be premature because other teams exhibited the opposite pattern. Taken together, results illustrate how big team science can be leveraged to understand the promises and limitations of machine learning methods in affective science and beyond.
- Open Access
Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking
Refractive errors are among the most common visual impairments globally, yet their diagnosis often relies on active user participation and clinical oversight. This study explores a passive method for estimating refractive power using two eye movement recording techniques: electrooculography (EOG) and video-based eye tracking. Using a publicly available dataset recorded under varying diopter conditions, we trained Long Short-Term Memory (LSTM) models to classify refractive power from unimodal (EOG or eye tracking) and multimodal configuration. We assess performance in both subject-dependent and subject-independent settings to evaluate model personalization and generalizability across individuals. Results show that the multimodal model consistently outperforms unimodal models, achieving the highest average accuracy in both settings: 96.207\% in the subject-dependent scenario and 8.882\% in the subject-independent scenario. However, generalization remains limited, with classification accuracy only marginally above chance in the subject-independent evaluations. Statistical comparisons in the subject-dependent setting confirmed that the multimodal model significantly outperformed the EOG and eye-tracking models. However, no statistically significant differences were found in the subject-independent setting. Our findings demonstrate both the potential and current limitations of eye movement data-based refractive error estimation, contributing to the development of continuous, non-invasive screening methods using EOG signals and eye-tracking data.
Open AccessMind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking
Refractive errors are among the most common visual impairments globally, yet their diagnosis often relies on active user participation and clinical oversight. This study explores a passive method for estimating refractive power using two eye movement recording techniques: electrooculography (EOG) and video-based eye tracking. Using a publicly available dataset recorded under varying diopter conditions, we trained Long Short-Term Memory (LSTM) models to classify refractive power from unimodal (EOG or eye tracking) and multimodal configuration. We assess performance in both subject-dependent and subject-independent settings to evaluate model personalization and generalizability across individuals. Results show that the multimodal model consistently outperforms unimodal models, achieving the highest average accuracy in both settings: 96.207\% in the subject-dependent scenario and 8.882\% in the subject-independent scenario. However, generalization remains limited, with classification accuracy only marginally above chance in the subject-independent evaluations. Statistical comparisons in the subject-dependent setting confirmed that the multimodal model significantly outperformed the EOG and eye-tracking models. However, no statistically significant differences were found in the subject-independent setting. Our findings demonstrate both the potential and current limitations of eye movement data-based refractive error estimation, contributing to the development of continuous, non-invasive screening methods using EOG signals and eye-tracking data.
- Open Access
Ensemble Learning to Assess Dynamics of Affective Experience Ratings and Physiological Change
The congruence between affective experiences and physiological changes has been a debated topic for centuries. Recent technological advances in measurement and data analysis provide hope to solve this epic challenge. Open science and open data practices, together with data analysis challenges open to the academic community, are also promising tools for solving this problem. In this entry to the Emotion Physiology and Experience Collaboration (EPiC) challenge, we propose a data analysis solution that combines theoretical assumptions with data-driven methodologies. We used feature engineering and ensemble selection. Each predictor was trained on subsets of the training data that would maximize the information available for training. Late fusion was used with an averaging step. We chose to average considering a ``wisdom of crowds'' strategy. This strategy yielded an overall RMSE of 1.19 in the test set. Future work should carefully explore if our assumptions are correct and the potential of weighted fusion.
Open AccessEnsemble Learning to Assess Dynamics of Affective Experience Ratings and Physiological Change
The congruence between affective experiences and physiological changes has been a debated topic for centuries. Recent technological advances in measurement and data analysis provide hope to solve this epic challenge. Open science and open data practices, together with data analysis challenges open to the academic community, are also promising tools for solving this problem. In this entry to the Emotion Physiology and Experience Collaboration (EPiC) challenge, we propose a data analysis solution that combines theoretical assumptions with data-driven methodologies. We used feature engineering and ensemble selection. Each predictor was trained on subsets of the training data that would maximize the information available for training. Late fusion was used with an averaging step. We chose to average considering a ``wisdom of crowds'' strategy. This strategy yielded an overall RMSE of 1.19 in the test set. Future work should carefully explore if our assumptions are correct and the potential of weighted fusion.
- 21 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-13
DUET: Improving Inertial-Based Odometry via Deep IMU Online Calibration
This paper presents a deep data-driven inertial measurement unit (IMU) online calibration (DUET) method that can compensate for the run-time errors of the accelerometer and gyroscope to improve inertial-based odometry. We design a differential error learning strategy based on the kinematic motion model to train the sensor error compensation model. This strategy allows our method to learn IMU sensor errors, such as scale factors, axis-misalignment, and biases, solely from displacement and orientation increments given by external tracking systems. Then during the odometry computation, the trained model leverages the past inertial data to mitigate the sensor errors and thus reduces the integration errors to reflect the odometry state. The experiments conducted on two public visual-inertial datasets show an average of 20% improvement in the position estimation accuracy of visual-inertial odometry, which is comparable to existing learning-based methods with lower operational complexity.
- 21 August 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 72 (00189456) , 1-13
DUET: Improving Inertial-Based Odometry via Deep IMU Online Calibration
This paper presents a deep data-driven inertial measurement unit (IMU) online calibration (DUET) method that can compensate for the run-time errors of the accelerometer and gyroscope to improve inertial-based odometry. We design a differential error learning strategy based on the kinematic motion model to train the sensor error compensation model. This strategy allows our method to learn IMU sensor errors, such as scale factors, axis-misalignment, and biases, solely from displacement and orientation increments given by external tracking systems. Then during the odometry computation, the trained model leverages the past inertial data to mitigate the sensor errors and thus reduces the integration errors to reflect the odometry state. The experiments conducted on two public visual-inertial datasets show an average of 20% improvement in the position estimation accuracy of visual-inertial odometry, which is comparable to existing learning-based methods with lower operational complexity.