Doreen Jirak
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Doreen Jirak has a total of 18 co-authors. Here are the top co-authors by number of shared publications:
- Stefan Wermter
University of Hamburg
3 shared publications - Anna Maria Borghi
Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, via degli Apuli 1, 00185 Rome, Italy; Institute of Cognitive Sciences and Technologies, Italian National Research Council, via Romagnosi 18/A, 00196 Rome, Italy
1 shared publication Claudia R. Eickhoff
Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
1 shared publication- Cornelius Weber
Department of Informatics, University of Hamburg, Hamburg, Germany
1 shared publication - David Biertimpel
Science Faculty, University of Amsterdam, Amsterdam, The Netherlands
1 shared publication - Ferdinand Binkofski
RWTH Aachen University
1 shared publication
Latest Publications
- Open Access
- 7 October 2020
- Published by Springer Nature in Cognitive Computation
- Vol. 15 (5) , 1427-1439
Echo State Networks and Long Short-Term Memory for Continuous Gesture Recognition: a Comparative Study
Recent developments of sensors that allow tracking of human movements and gestures enable rapid progress of applications in domains like medical rehabilitation or robotic control. Especially the inertial measurement unit (IMU) is an excellent device for real-time scenarios as it rapidly delivers data input. Therefore, a computational model must be able to learn gesture sequences in a fast yet robust way. We recently introduced an echo state network (ESN) framework for continuous gesture recognition (Tietz et al., 2019) including novel approaches for gesture spotting, i.e., the automatic detection of the start and end phase of a gesture. Although our results showed good classification performance, we identified significant factors which also negatively impact the performance like subgestures and gesture variability. To address these issues, we include experiments with Long Short-Term Memory (LSTM) networks, which is a state-of-the-art model for sequence processing, to compare the obtained results with our framework and to evaluate their robustness regarding pitfalls in the recognition process. In this study, we analyze the two conceptually different approaches processing continuous, variable-length gesture sequences, which shows interesting results comparing the distinct gesture accomplishments. In addition, our results demonstrate that our ESN framework achieves comparably good performance as the LSTM network but has significantly lower training times. We conclude from the present work that ESNs are viable models for continuous gesture recognition delivering reasonable performance for applications requiring real-time performance as in robotic or rehabilitation tasks. From our discussion of this comparative study, we suggest prospective improvements on both the experimental and network architecture level.
- 7 October 2020
- Published by Springer Nature in Cognitive Computation
- Vol. 15 (5) , 1427-1439
Open AccessEcho State Networks and Long Short-Term Memory for Continuous Gesture Recognition: a Comparative Study
Recent developments of sensors that allow tracking of human movements and gestures enable rapid progress of applications in domains like medical rehabilitation or robotic control. Especially the inertial measurement unit (IMU) is an excellent device for real-time scenarios as it rapidly delivers data input. Therefore, a computational model must be able to learn gesture sequences in a fast yet robust way. We recently introduced an echo state network (ESN) framework for continuous gesture recognition (Tietz et al., 2019) including novel approaches for gesture spotting, i.e., the automatic detection of the start and end phase of a gesture. Although our results showed good classification performance, we identified significant factors which also negatively impact the performance like subgestures and gesture variability. To address these issues, we include experiments with Long Short-Term Memory (LSTM) networks, which is a state-of-the-art model for sequence processing, to compare the obtained results with our framework and to evaluate their robustness regarding pitfalls in the recognition process. In this study, we analyze the two conceptually different approaches processing continuous, variable-length gesture sequences, which shows interesting results comparing the distinct gesture accomplishments. In addition, our results demonstrate that our ESN framework achieves comparably good performance as the LSTM network but has significantly lower training times. We conclude from the present work that ESNs are viable models for continuous gesture recognition delivering reasonable performance for applications requiring real-time performance as in robotic or rehabilitation tasks. From our discussion of this comparative study, we suggest prospective improvements on both the experimental and network architecture level.
- Open Access
- 30 June 2020
- Published by Springer Nature in Neural Computing and Applications
- Vol. 33 (7) , 2297-2319
Solving visual object ambiguities when pointing: an unsupervised learning approach
Whenever we are addressing a specific object or refer to a certain spatial location, we are using referential or deictic gestures usually accompanied by some verbal description. Particularly, pointing gestures are necessary to dissolve ambiguities in a scene and they are of crucial importance when verbal communication may fail due to environmental conditions or when two persons simply do not speak the same language. With the currently increasing advances of humanoid robots and their future integration in domestic domains, the development of gesture interfaces complementing human–robot interaction scenarios is of substantial interest. The implementation of an intuitive gesture scenario is still challenging because both the pointing intention and the corresponding object have to be correctly recognized in real time. The demand increases when considering pointing gestures in a cluttered environment, as is the case in households. Also, humans perform pointing in many different ways and those variations have to be captured. Research in this field often proposes a set of geometrical computations which do not scale well with the number of gestures and objects and use specific markers or a predefined set of pointing directions. In this paper, we propose an unsupervised learning approach to model the distribution of pointing gestures using a growing-when-required (GWR) network. We introduce an interaction scenario with a humanoid robot and define the so-called ambiguity classes. Our implementation for the hand and object detection is independent of any markers or skeleton models; thus, it can be easily reproduced. Our evaluation comparing a baseline computer vision approach with our GWR model shows that the pointing-object association is well learned even in cases of ambiguities resulting from close object proximity.
- 30 June 2020
- Published by Springer Nature in Neural Computing and Applications
- Vol. 33 (7) , 2297-2319
Open AccessSolving visual object ambiguities when pointing: an unsupervised learning approach
Whenever we are addressing a specific object or refer to a certain spatial location, we are using referential or deictic gestures usually accompanied by some verbal description. Particularly, pointing gestures are necessary to dissolve ambiguities in a scene and they are of crucial importance when verbal communication may fail due to environmental conditions or when two persons simply do not speak the same language. With the currently increasing advances of humanoid robots and their future integration in domestic domains, the development of gesture interfaces complementing human–robot interaction scenarios is of substantial interest. The implementation of an intuitive gesture scenario is still challenging because both the pointing intention and the corresponding object have to be correctly recognized in real time. The demand increases when considering pointing gestures in a cluttered environment, as is the case in households. Also, humans perform pointing in many different ways and those variations have to be captured. Research in this field often proposes a set of geometrical computations which do not scale well with the number of gestures and objects and use specific markers or a predefined set of pointing directions. In this paper, we propose an unsupervised learning approach to model the distribution of pointing gestures using a growing-when-required (GWR) network. We introduce an interaction scenario with a humanoid robot and define the so-called ambiguity classes. Our implementation for the hand and object detection is independent of any markers or skeleton models; thus, it can be easily reproduced. Our evaluation comparing a baseline computer vision approach with our GWR model shows that the pointing-object association is well learned even in cases of ambiguities resulting from close object proximity.
- 9 September 2019
- Published by Springer Nature
- p. 7-18
A Reservoir Computing Framework for Continuous Gesture Recognition
- 9 September 2019
- Published by Springer Nature
- p. 7-18
A Reservoir Computing Framework for Continuous Gesture Recognition
- 1 October 2016
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 69, 89-112
Affordance processing in segregated parieto-frontal dorsal stream sub-pathways
- 1 October 2016
- Published by Elsevier in Neuroscience & Biobehavioral Reviews
- Vol. 69, 89-112
Affordance processing in segregated parieto-frontal dorsal stream sub-pathways
- Open Access
- 1 December 2015
- Published by Elsevier in Neural Networks
- Vol. 72, 140-151
Multimodal emotional state recognition using sequence-dependent deep hierarchical features
- 1 December 2015
- Published by Elsevier in Neural Networks
- Vol. 72, 140-151
Open AccessMultimodal emotional state recognition using sequence-dependent deep hierarchical features