E. Yu. Shelepin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
E. Yu. Shelepin has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- G. A. Moiseenko
Pavlov Institute of Physiology, Russian Academy of Sciences, St. Petersburg, Russia
1 shared publication - Hao-Teng Hsu
Department of Electrical Engineering, National Central University, Taoyuan 320, Taiwan
1 shared publication K. A. Skuratova
Pavlov Institute of Physiology, Russian Academy of Sciences, St. Petersburg, Russia
1 shared publication- Narisa Nan Chu
CWLab International, Los Angeles, California, USA
1 shared publication - O. V. Zhukova
Pavlov Institute of Physiology, Russian Academy of Sciences, St. Petersburg, Russia
1 shared publication - P. P. Vasil’ev
I. P. Pavlov Institute of Physiology of the Russian Academy of Sciences, St. Petersburg, Russia
1 shared publication
Latest Publications
- 1 August 2022
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 89 (8) , 454-460
Hardware and software complex for the detection and identification of informative features in images of means of nonverbal communication
Subject of study. Techniques for identifying informative features in dynamic images (video) of means of nonverbal communication of operators during a joint constructive activity were the subject of this study. Aim of study. This study aimed to develop methods for detecting and identifying significant features of nonverbal communication in the received dynamic (video) images of faces of partners, i.e., key features in the joint activity of partners upon disabling the verbal communication channel. Method. A technique for interaction was developed, with a hardware and software complex designed for identifying communication markers in images of facial expressions and eye movements of partners during a joint play activity, in which nonverbal communication is a key aspect and the speech communication channel is disabled. The joint activity involved one partner searching for a hidden target in the perceived image using a nonverbal clue from the second partner, who views the target position on his screen. Partners were chosen among representatives of two geographically distant cultures—Russian and Chinese. The interactions of the partners during their work with images of the object of activity received via simultaneous video communication in two research centers located in western and eastern Eurasia were evaluated through simultaneously recorded physiological parameters. Main results. A new algorithm for investigating images as a means of nonverbal interaction for ensuring the achievement of a shared goal without the speech communication channel was designed. The effectiveness of eye movements of the partners, which are the key features of nonverbal communication, was demonstrated during the constructive joint activity. The task was presented to Chinese and Russian test subjects in the form of English text. Based on the performed measurements, nonverbal interaction in the task of looking for the target position functions similarly for representatives of both cultures and depends on the roles of the partners and the type of executed task. The correlation between the activities of different neural networks of the brain that ensure the recognition of images during the target search in nonverbal communication was identified. An analysis of the images of eye movement during the communication isolated a classic pattern of eye capture for guided and guiding partners. Constant switching occurs between the assessment of images of partners’ eyes and the target search in the entire image. The obtained results suggest that 1) the cognitive process of recognition of facial expressions is probably the most complex visual cognitive process, and 2) universal behavioral algorithms exist when a common joint activity understandable to both partners is performed. Practical significance. A hardware and software complex for detecting significant features of nonverbal communication in the images of faces was designed. The working capacity of the proposed method for detecting features was demonstrated using clear basic signals of nonverbal communication, thus enabling new methods of training artificial neural networks to ensure intuitive nonverbal communication between machines and humans via the recognition of hidden markers of nonverbal communication.
- 1 August 2022
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 89 (8) , 454-460
Hardware and software complex for the detection and identification of informative features in images of means of nonverbal communication
Subject of study. Techniques for identifying informative features in dynamic images (video) of means of nonverbal communication of operators during a joint constructive activity were the subject of this study. Aim of study. This study aimed to develop methods for detecting and identifying significant features of nonverbal communication in the received dynamic (video) images of faces of partners, i.e., key features in the joint activity of partners upon disabling the verbal communication channel. Method. A technique for interaction was developed, with a hardware and software complex designed for identifying communication markers in images of facial expressions and eye movements of partners during a joint play activity, in which nonverbal communication is a key aspect and the speech communication channel is disabled. The joint activity involved one partner searching for a hidden target in the perceived image using a nonverbal clue from the second partner, who views the target position on his screen. Partners were chosen among representatives of two geographically distant cultures—Russian and Chinese. The interactions of the partners during their work with images of the object of activity received via simultaneous video communication in two research centers located in western and eastern Eurasia were evaluated through simultaneously recorded physiological parameters. Main results. A new algorithm for investigating images as a means of nonverbal interaction for ensuring the achievement of a shared goal without the speech communication channel was designed. The effectiveness of eye movements of the partners, which are the key features of nonverbal communication, was demonstrated during the constructive joint activity. The task was presented to Chinese and Russian test subjects in the form of English text. Based on the performed measurements, nonverbal interaction in the task of looking for the target position functions similarly for representatives of both cultures and depends on the roles of the partners and the type of executed task. The correlation between the activities of different neural networks of the brain that ensure the recognition of images during the target search in nonverbal communication was identified. An analysis of the images of eye movement during the communication isolated a classic pattern of eye capture for guided and guiding partners. Constant switching occurs between the assessment of images of partners’ eyes and the target search in the entire image. The obtained results suggest that 1) the cognitive process of recognition of facial expressions is probably the most complex visual cognitive process, and 2) universal behavioral algorithms exist when a common joint activity understandable to both partners is performed. Practical significance. A hardware and software complex for detecting significant features of nonverbal communication in the images of faces was designed. The working capacity of the proposed method for detecting features was demonstrated using clear basic signals of nonverbal communication, thus enabling new methods of training artificial neural networks to ensure intuitive nonverbal communication between machines and humans via the recognition of hidden markers of nonverbal communication.
- 1 October 2020
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 87 (10) , 619-623
Global and local mechanisms of perception of "compound letters"
This study describes an algorithm of temporal interaction of spatial mechanisms for global and local analysis in recognition of "compound letters" by second-grade students including some with speech disorders. A method of "compound letters" was used, that models some properties of reading without line-by-line text scanning. Large "compound letters" are composed of small letters. Large "compound letters" are congruent if they are composed of the same letters; otherwise, they are incongruent. The test subject was asked to recognize either a large (global task) or a small (local task) letter in the "compound letter" and press the corresponding button. The number of correct/incorrect responses and the reaction time were registered. The responses of second-grade students with and without speech disorders were compared. The percentage of correct responses in recognition of large and small, congruent and incongruent letters was identical, but the response times were different for these groups of test subjects. The temporal properties of interaction of vision system channels that are responsible for local and global analysis during text recognition and speech production were assumed to be important. (C) 2021 Optical Society of America
- 1 October 2020
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 87 (10) , 619-623
Global and local mechanisms of perception of "compound letters"
This study describes an algorithm of temporal interaction of spatial mechanisms for global and local analysis in recognition of "compound letters" by second-grade students including some with speech disorders. A method of "compound letters" was used, that models some properties of reading without line-by-line text scanning. Large "compound letters" are composed of small letters. Large "compound letters" are congruent if they are composed of the same letters; otherwise, they are incongruent. The test subject was asked to recognize either a large (global task) or a small (local task) letter in the "compound letter" and press the corresponding button. The number of correct/incorrect responses and the reaction time were registered. The responses of second-grade students with and without speech disorders were compared. The percentage of correct responses in recognition of large and small, congruent and incongruent letters was identical, but the response times were different for these groups of test subjects. The temporal properties of interaction of vision system channels that are responsible for local and global analysis during text recognition and speech production were assumed to be important. (C) 2021 Optical Society of America
- 1 August 2018
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 85 (8) , 521-523
Optimization of site content in the learning process
The aim of the study is to optimize the content in the learning process to increase the effectiveness of learning by matching it with perception, attention, and reading. The results obtained indicate that the format of the visual display of text affects the characteristics of reading. In addition, the influence of font images, word length, and frequency of word usage on oculomotor activity (number of fixations, number of views, and view length) are shown. Differences in the visual formats of texts are also evident in reading comprehension and when comparing both the indirect evaluations (the shingles method) and the self-evaluations of the subjects. Furthermore, according to the indicators of self-evaluation and reading speed, the standard text format shows greater efficiency. Moreover, it is shown that the coloring of fragments of the text accelerates the reading process. This is consistent with the data indicating that the isolation of syllables (coloring) makes the task of reading easier for children with dyslexia.
- 1 August 2018
- Published by Optica Publishing Group in Journal of Optical Technology
- Vol. 85 (8) , 521-523
Optimization of site content in the learning process
The aim of the study is to optimize the content in the learning process to increase the effectiveness of learning by matching it with perception, attention, and reading. The results obtained indicate that the format of the visual display of text affects the characteristics of reading. In addition, the influence of font images, word length, and frequency of word usage on oculomotor activity (number of fixations, number of views, and view length) are shown. Differences in the visual formats of texts are also evident in reading comprehension and when comparing both the indirect evaluations (the shingles method) and the self-evaluations of the subjects. Furthermore, according to the indicators of self-evaluation and reading speed, the standard text format shows greater efficiency. Moreover, it is shown that the coloring of fragments of the text accelerates the reading process. This is consistent with the data indicating that the isolation of syllables (coloring) makes the task of reading easier for children with dyslexia.