Andrey Rudenko
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Andrey Rudenko has a total of 64 co-authors. Here are the top co-authors by number of shared publications:
- Achim J. Lilienthal
Örebro University
8 shared publications - Luigi Palmieri
Robert Bosch GmbH
7 shared publications - Tomasz Piotr Kucner
Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, Espoo, Finland
4 shared publications - Barbara Bruno
Karlsruhe Institute of Technology, Karlsruhe, Germany
3 shared publications Kai O. Arras
Robert Bosch GmbH Corporate Research Stuttgart Germany
3 shared publicationsMartin Magnusson
Örebro University
3 shared publications
Latest Publications
- Open Access
- 31 May 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Accurate 3D Gaze Estimation in a Controlled Environment using Gaze-tracking Glasses and Motion Capture
In this paper, we present a lab setup to measure accurate 3D gaze positions of a person during unconstrained navigation and interaction in an environment with known geometry. We evaluate the accuracy of distance measurements up to 5.7m and compare them with baseline vergence-point estimation of the Tobii Pro Glasses 3.
- 31 May 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-3
Open AccessAccurate 3D Gaze Estimation in a Controlled Environment using Gaze-tracking Glasses and Motion Capture
In this paper, we present a lab setup to measure accurate 3D gaze positions of a person during unconstrained navigation and interaction in an environment with known geometry. We evaluate the accuracy of distance measurements up to 5.7m and compare them with baseline vergence-point estimation of the Tobii Pro Glasses 3.
- 9 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (11) , 12229-12236
Long-Term Human Motion Prediction Using Spatio-Temporal Maps of Dynamics
Long-term human motion prediction (LHMP) is important for the safe and efficient operation of autonomous robots and vehicles in environments shared with humans. Accurate predictions are important for applications including motion planning, tracking, human-robot interaction, and safety monitoring. In this paper, we exploit Maps of Dynamics (MoDs), which encode spatial or spatio-temporal motion patterns as environment features, to achieve LHMP for horizons of up to 60 seconds. We propose an MoD-informed LHMP framework that supports various types of MoDs and includes a ranking method to output the most likely predicted trajectory, improving practical utility in robotics. Further, a time-conditioned MoD is introduced to capture motion patterns that vary across different times of day. We evaluate MoD-LHMP instantiated with three types of MoDs. Experiments on two real-world datasets show that MoD-informed method outperforms learning-based ones, with up to 50% improvement in average displacement error, and the time-conditioned variant achieves the highest accuracy overall.
- 9 October 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 10 (11) , 12229-12236
Long-Term Human Motion Prediction Using Spatio-Temporal Maps of Dynamics
Long-term human motion prediction (LHMP) is important for the safe and efficient operation of autonomous robots and vehicles in environments shared with humans. Accurate predictions are important for applications including motion planning, tracking, human-robot interaction, and safety monitoring. In this paper, we exploit Maps of Dynamics (MoDs), which encode spatial or spatio-temporal motion patterns as environment features, to achieve LHMP for horizons of up to 60 seconds. We propose an MoD-informed LHMP framework that supports various types of MoDs and includes a ranking method to output the most likely predicted trajectory, improving practical utility in robotics. Further, a time-conditioned MoD is introduced to capture motion patterns that vary across different times of day. We evaluate MoD-LHMP instantiated with three types of MoDs. Experiments on two real-world datasets show that MoD-informed method outperforms learning-based ones, with up to 50% improvement in average displacement error, and the time-conditioned variant achieves the highest accuracy overall.
- 22 May 2025
- Published by Springer Nature
- p. 155-161
DARKO-Nav: Hierarchical Risk and Context-Aware Robot Navigation in Complex Intralogistic Environments
- 22 May 2025
- Published by Springer Nature
- p. 155-161
DARKO-Nav: Hierarchical Risk and Context-Aware Robot Navigation in Complex Intralogistic Environments
- Open Access
- 21 October 2024
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 44 (4) , 568-591
THÖR-MAGNI: A large-scale indoor motion capture recording of human movement and robot interaction
We present a new large dataset of indoor human and robot navigation and interaction, called THÖR-MAGNI, that is designed to facilitate research on social human navigation: for example, modeling and predicting human motion, analyzing goal-oriented interactions between humans and robots, and investigating visual attention in a social interaction context. THÖR-MAGNI was created to fill a gap in available datasets for human motion analysis and HRI. This gap is characterized by a lack of comprehensive inclusion of exogenous factors and essential target agent cues, which hinders the development of robust models capable of capturing the relationship between contextual cues and human behavior in different scenarios. Unlike existing datasets, THÖR-MAGNI includes a broader set of contextual features and offers multiple scenario variations to facilitate factor isolation. The dataset includes many social human–human and human–robot interaction scenarios, rich context annotations, and multi-modal data, such as walking trajectories, gaze-tracking data, and lidar and camera streams recorded from a mobile robot. We also provide a set of tools for visualization and processing of the recorded data. THÖR-MAGNI is, to the best of our knowledge, unique in the amount and diversity of sensor data collected in a contextualized and socially dynamic environment, capturing natural human–robot interactions.
- 21 October 2024
- Published by SAGE Publications in The International Journal of Robotics Research
- Vol. 44 (4) , 568-591
Open AccessTHÖR-MAGNI: A large-scale indoor motion capture recording of human movement and robot interaction
We present a new large dataset of indoor human and robot navigation and interaction, called THÖR-MAGNI, that is designed to facilitate research on social human navigation: for example, modeling and predicting human motion, analyzing goal-oriented interactions between humans and robots, and investigating visual attention in a social interaction context. THÖR-MAGNI was created to fill a gap in available datasets for human motion analysis and HRI. This gap is characterized by a lack of comprehensive inclusion of exogenous factors and essential target agent cues, which hinders the development of robust models capable of capturing the relationship between contextual cues and human behavior in different scenarios. Unlike existing datasets, THÖR-MAGNI includes a broader set of contextual features and offers multiple scenario variations to facilitate factor isolation. The dataset includes many social human–human and human–robot interaction scenarios, rich context annotations, and multi-modal data, such as walking trajectories, gaze-tracking data, and lidar and camera streams recorded from a mobile robot. We also provide a set of tools for visualization and processing of the recorded data. THÖR-MAGNI is, to the best of our knowledge, unique in the amount and diversity of sensor data collected in a contextualized and socially dynamic environment, capturing natural human–robot interactions.
- 13 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9494-9501
Efficient Context-Aware Model Predictive Control for Human-Aware Navigation
With the goal of creating efficient human-aware robot navigation systems, we present a Context-aware Model Predictive Control (MPC) formulation designed specifically for dynamic and crowded environments. State-of-the-art approaches use mainly geometric information and predictions of human motion, thus being proactive about human positions and intents but less aware of high-level behaviors encoded in contextual cues of human activities. In contrast to that, we propose a holistic planning solution that considers additional contextual information such as 3D human body poses with their velocities and recognized activities. We carefully design the MPC formulation to facilitate the integration of modern perception systems and the usage of fast solvers for embedded robot motion optimization. Compared to a set of baselines, our proposed system not only ensures safety but also significantly improves task and computational efficiency. Through extensive simulations and real-life experiments, our planner demonstrates reliable operation in terms of smooth and efficient navigation in human-populated areas.
- 13 September 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (11) , 9494-9501
Efficient Context-Aware Model Predictive Control for Human-Aware Navigation
With the goal of creating efficient human-aware robot navigation systems, we present a Context-aware Model Predictive Control (MPC) formulation designed specifically for dynamic and crowded environments. State-of-the-art approaches use mainly geometric information and predictions of human motion, thus being proactive about human positions and intents but less aware of high-level behaviors encoded in contextual cues of human activities. In contrast to that, we propose a holistic planning solution that considers additional contextual information such as 3D human body poses with their velocities and recognized activities. We carefully design the MPC formulation to facilitate the integration of modern perception systems and the usage of fast solvers for embedded robot motion optimization. Compared to a set of baselines, our proposed system not only ensures safety but also significantly improves task and computational efficiency. Through extensive simulations and real-life experiments, our planner demonstrates reliable operation in terms of smooth and efficient navigation in human-populated areas.
- Open Access
Bidirectional Intent Communication: A Role for Large Foundation Models
Integrating multimodal foundation models has significantly enhanced autonomous agents' language comprehension, perception, and planning capabilities. However, while existing works adopt a \emph{task-centric} approach with minimal human interaction, applying these models to developing assistive \emph{user-centric} robots that can interact and cooperate with humans remains underexplored. This paper introduces ``Bident'', a framework designed to integrate robots seamlessly into shared spaces with humans. Bident enhances the interactive experience by incorporating multimodal inputs like speech and user gaze dynamics. Furthermore, Bident supports verbal utterances and physical actions like gestures, making it versatile for bidirectional human-robot interactions. Potential applications include personalized education, where robots can adapt to individual learning styles and paces, and healthcare, where robots can offer personalized support, companionship, and everyday assistance in the home and workplace environments.
Open AccessBidirectional Intent Communication: A Role for Large Foundation Models
Integrating multimodal foundation models has significantly enhanced autonomous agents' language comprehension, perception, and planning capabilities. However, while existing works adopt a \emph{task-centric} approach with minimal human interaction, applying these models to developing assistive \emph{user-centric} robots that can interact and cooperate with humans remains underexplored. This paper introduces ``Bident'', a framework designed to integrate robots seamlessly into shared spaces with humans. Bident enhances the interactive experience by incorporating multimodal inputs like speech and user gaze dynamics. Furthermore, Bident supports verbal utterances and physical actions like gestures, making it versatile for bidirectional human-robot interactions. Potential applications include personalized education, where robots can adapt to individual learning styles and paces, and healthcare, where robots can offer personalized support, companionship, and everyday assistance in the home and workplace environments.
- Open Access
- 14 August 2024
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 16 (8) , 1879-1900
The Child Factor in Child–Robot Interaction: Discovering the Impact of Developmental Stage and Individual Characteristics
Social robots, owing to their embodied physical presence in human spaces and the ability to directly interact with the users and their environment, have a great potential to support children in various activities in education, healthcare and daily life. Child–Robot Interaction (CRI), as any domain involving children, inevitably faces the major challenge of designing generalized strategies to work with unique, turbulent and very diverse individuals. Addressing this challenging endeavor requires to combine the standpoint of the robot-centered perspective, i.e. what robots technically can and are best positioned to do, with that of the child-centered perspective, i.e. what children may gain from the robot and how the robot should act to best support them in reaching the goals of the interaction. This article aims to help researchers bridge the two perspectives and proposes to address the development of CRI scenarios with insights from child psychology and child development theories. To that end, we review the outcomes of the CRI studies, outline common trends and challenges, and identify two key factors from child psychology that impact child-robot interactions, especially in a long-term perspective: developmental stage and individual characteristics. For both of them we discuss prospective experiment designs which support building naturally engaging and sustainable interactions.
- 14 August 2024
- Published by Springer Nature in International Journal of Social Robotics
- Vol. 16 (8) , 1879-1900
Open AccessThe Child Factor in Child–Robot Interaction: Discovering the Impact of Developmental Stage and Individual Characteristics
Social robots, owing to their embodied physical presence in human spaces and the ability to directly interact with the users and their environment, have a great potential to support children in various activities in education, healthcare and daily life. Child–Robot Interaction (CRI), as any domain involving children, inevitably faces the major challenge of designing generalized strategies to work with unique, turbulent and very diverse individuals. Addressing this challenging endeavor requires to combine the standpoint of the robot-centered perspective, i.e. what robots technically can and are best positioned to do, with that of the child-centered perspective, i.e. what children may gain from the robot and how the robot should act to best support them in reaching the goals of the interaction. This article aims to help researchers bridge the two perspectives and proposes to address the development of CRI scenarios with insights from child psychology and child development theories. To that end, we review the outcomes of the CRI studies, outline common trends and challenges, and identify two key factors from child psychology that impact child-robot interactions, especially in a long-term perspective: developmental stage and individual characteristics. For both of them we discuss prospective experiment designs which support building naturally engaging and sustainable interactions.
- 3 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6576-6583
Trajectory Prediction for Heterogeneous Agents: A Performance Analysis on Small and Imbalanced Datasets
Robots and other intelligent systems navigating in complex dynamic environments should predict future actions and intentions of surrounding agents to reach their goals efficiently and avoid collisions. The dynamics of those agents strongly depends on their tasks, roles, or observable labels. Class-conditioned motion prediction is thus an appealing way to reduce forecast uncertainty and get more accurate predictions for heterogeneous agents. However, this is hardly explored in the prior art, especially for mobile robots and in limited data applications. In this paper, we analyse different class-conditioned trajectory prediction methods on two datasets. We propose a set of conditional pattern-based and efficient deep learning-based baselines, and evaluate their performance on robotics and outdoors datasets (THÖR-MAGNI and Stanford Drone Dataset). Our experiments show that all methods improve accuracy in most of the settings when considering class labels. More importantly, we observe that there are significant differences when learning from imbalanced datasets, or in new environments where sufficient data is not available. In particular, we find that deep learning methods perform better on balanced datasets, but in applications with limited data, e.g., cold start of a robot in a new environment, or imbalanced classes, pattern-based methods may be preferable.
- 3 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 9 (7) , 6576-6583
Trajectory Prediction for Heterogeneous Agents: A Performance Analysis on Small and Imbalanced Datasets
Robots and other intelligent systems navigating in complex dynamic environments should predict future actions and intentions of surrounding agents to reach their goals efficiently and avoid collisions. The dynamics of those agents strongly depends on their tasks, roles, or observable labels. Class-conditioned motion prediction is thus an appealing way to reduce forecast uncertainty and get more accurate predictions for heterogeneous agents. However, this is hardly explored in the prior art, especially for mobile robots and in limited data applications. In this paper, we analyse different class-conditioned trajectory prediction methods on two datasets. We propose a set of conditional pattern-based and efficient deep learning-based baselines, and evaluate their performance on robotics and outdoors datasets (THÖR-MAGNI and Stanford Drone Dataset). Our experiments show that all methods improve accuracy in most of the settings when considering class labels. More importantly, we observe that there are significant differences when learning from imbalanced datasets, or in new environments where sufficient data is not available. In particular, we find that deep learning methods perform better on balanced datasets, but in applications with limited data, e.g., cold start of a robot in a new environment, or imbalanced classes, pattern-based methods may be preferable.
- Open Access
The Child Factor in Child-Robot Interaction: Discovering the Impact of Developmental Stage and Individual Characteristics
Social robots, owing to their embodied physical presence in human spaces and the ability to directly interact with the users and their environment, have a great potential to support children in various activities in education, healthcare and daily life. Child-Robot Interaction (CRI), as any domain involving children, inevitably faces the major challenge of designing generalized strategies to work with unique, turbulent and very diverse individuals. Addressing this challenging endeavor requires to combine the standpoint of the robot-centered perspective, i.e. what robots technically can and are best positioned to do, with that of the child-centered perspective, i.e. what children may gain from the robot and how the robot should act to best support them in reaching the goals of the interaction. This article aims to help researchers bridge the two perspectives and proposes to address the development of CRI scenarios with insights from child psychology and child development theories. To that end, we review the outcomes of the CRI studies, outline common trends and challenges, and identify two key factors from child psychology that impact child-robot interactions, especially in a long-term perspective: developmental stage and individual characteristics. For both of them we discuss prospective experiment designs which support building naturally engaging and sustainable interactions.
Open AccessThe Child Factor in Child-Robot Interaction: Discovering the Impact of Developmental Stage and Individual Characteristics
Social robots, owing to their embodied physical presence in human spaces and the ability to directly interact with the users and their environment, have a great potential to support children in various activities in education, healthcare and daily life. Child-Robot Interaction (CRI), as any domain involving children, inevitably faces the major challenge of designing generalized strategies to work with unique, turbulent and very diverse individuals. Addressing this challenging endeavor requires to combine the standpoint of the robot-centered perspective, i.e. what robots technically can and are best positioned to do, with that of the child-centered perspective, i.e. what children may gain from the robot and how the robot should act to best support them in reaching the goals of the interaction. This article aims to help researchers bridge the two perspectives and proposes to address the development of CRI scenarios with insights from child psychology and child development theories. To that end, we review the outcomes of the CRI studies, outline common trends and challenges, and identify two key factors from child psychology that impact child-robot interactions, especially in a long-term perspective: developmental stage and individual characteristics. For both of them we discuss prospective experiment designs which support building naturally engaging and sustainable interactions.
- Open Access
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 920-924
Drawings for Insight on Preschoolers' Perception of Robots
The design of robots and robot-mediated activities for children needs to be informed by their expectations on robots, to ensure acceptability and effectiveness. Children drawings are a powerful tool to understand and describe these expectations, containing actionable insights for robot designers. We report a preliminary study of 50 drawings made by preschool children and investigate (i) their perception of robots and (ii) the change in perception induced by a short experience with real robots. Our analyses reveal that the children's age not only influences their perception of robots, but also how their perception changes after encountering robots.
- 11 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 920-924
Open AccessDrawings for Insight on Preschoolers' Perception of Robots
The design of robots and robot-mediated activities for children needs to be informed by their expectations on robots, to ensure acceptability and effectiveness. Children drawings are a powerful tool to understand and describe these expectations, containing actionable insights for robot designers. We report a preliminary study of 50 drawings made by preschool children and investigate (i) their perception of robots and (ii) the change in perception induced by a short experience with real robots. Our analyses reveal that the children's age not only influences their perception of robots, but also how their perception changes after encountering robots.