George Chernyshov
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
George Chernyshov has a total of 38 co-authors. Here are the top co-authors by number of shared publications:
- Kai Kunze
TU CLausthal, CLausthal, Germany
8 shared publications - Jamie A. Ward
School of Computing, Goldsmiths, University of London, London, U.K.
5 shared publications - Danny Hynds
Keio University Graduate School of Media Design, Japan
4 shared publications - Dingding Zheng
Keio University Graduate School of Media Design, Japan
4 shared publications - Jing Huang
Tokyo University of the Arts, Tokyo, Japan
4 shared publications - Qing Zhang
The University of Tokyo, Tokyo, Japan
4 shared publications
Latest Publications
- Open Access
- 15 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 95-96
Collective Somatic Counterpoint
- 15 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 95-96
Open AccessCollective Somatic Counterpoint
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-16
"Speech is Silver, Silence is Golden " Analyzing Micro-communication Strategies between Visually Impaired Runners and their Guides
Running and jogging are popular activities for many visually impaired individuals thanks to the relatively low entry barriers. Research in HCI and beyond has focused primarily on leveraging technology to enable visually impaired people to run independently. However, depending on their residual vision and personal preferences, many chose to run with a sighted guide. This study presents a comprehensive analysis of the partnership between visually impaired runners and sighted guides. Using a combination of interaction and thematic analysis on video and interview data from 6 pairs of runners and guides, we unpack the complexity and directionality of three layers of vocal communication (directive, contextual, and recreational) and distinguish between intentional and unintentional corporeal communication. Building on the understanding of the importance of synchrony we also present some exploratory data looking at physiological synchrony between 2 pairs of runners with different level of experience and articulate recommendations for the HCI community.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open Access"Speech is Silver, Silence is Golden " Analyzing Micro-communication Strategies between Visually Impaired Runners and their Guides
Running and jogging are popular activities for many visually impaired individuals thanks to the relatively low entry barriers. Research in HCI and beyond has focused primarily on leveraging technology to enable visually impaired people to run independently. However, depending on their residual vision and personal preferences, many chose to run with a sighted guide. This study presents a comprehensive analysis of the partnership between visually impaired runners and sighted guides. Using a combination of interaction and thematic analysis on video and interview data from 6 pairs of runners and guides, we unpack the complexity and directionality of three layers of vocal communication (directive, contextual, and recreational) and distinguish between intentional and unintentional corporeal communication. Building on the understanding of the importance of synchrony we also present some exploratory data looking at physiological synchrony between 2 pairs of runners with different level of experience and articulate recommendations for the HCI community.
- Open Access
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Innermost Echoes: Integrating Real-Time Physiology into Live Music Performances
- 11 February 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessInnermost Echoes: Integrating Real-Time Physiology into Live Music Performances
- Open Access
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
First Bite/Chew: distinguish different types of food by first biting/chewing and the corresponding hand movement
Imbalanced food intake contributes to various diseases, such as obesity, diabetes, high blood pressure, high cholesterol, heart disease, and type-2 diabetes. At the same time, food intake monitoring systems play a significant role in the treatment. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. The challenges that remain are social acceptance, lightweight, easy to use, and inexpensive. Our method leverages two 6-axe Inertial Measurement Units (IMU) on the glasses’ leg and the wrist to detect the user’s food intake activities using a machine learning capable Micro Controller Unit (MCU). We introduced the concept of the first bite/chew, which is a stable and reliable indicator to distinguish food types. Our implementation results show that our method can distinguish seven kinds of food at an accuracy of 93.26% (average) over all four participants.
- 19 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessFirst Bite/Chew: distinguish different types of food by first biting/chewing and the corresponding hand movement
Imbalanced food intake contributes to various diseases, such as obesity, diabetes, high blood pressure, high cholesterol, heart disease, and type-2 diabetes. At the same time, food intake monitoring systems play a significant role in the treatment. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. The challenges that remain are social acceptance, lightweight, easy to use, and inexpensive. Our method leverages two 6-axe Inertial Measurement Units (IMU) on the glasses’ leg and the wrist to detect the user’s food intake activities using a machine learning capable Micro Controller Unit (MCU). We introduced the concept of the first bite/chew, which is a stable and reliable indicator to distinguish food types. Our implementation results show that our method can distinguish seven kinds of food at an accuracy of 93.26% (average) over all four participants.
- Open Access
- 12 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 326-329
First Bite/Chew: distinguish typical allergic food by two IMUs
Eating or overtaking allergic foods may cause fatal symptoms or even death for people with food allergies. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. However, challenges that remain are allergic food detection, social acceptance, lightweight, easy to use, and inexpensive. Our approach leverages the first bite/chew and the corresponding hand movement as an indicator to distinguish typical types of the allergic food. Our initial feasibility study shows that our approach can distinguish six types of food at an accuracy of 89.7% over all four participants’ mixed data. Particularly, our method successfully detected and distinguished typical allergic foods such as burgers (wheat), instant noodles (wheat), peanuts, egg fried rice, and edamame, which can be expected to contribute to not only personal use but also medical usage.
- 12 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 326-329
Open AccessFirst Bite/Chew: distinguish typical allergic food by two IMUs
Eating or overtaking allergic foods may cause fatal symptoms or even death for people with food allergies. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. However, challenges that remain are allergic food detection, social acceptance, lightweight, easy to use, and inexpensive. Our approach leverages the first bite/chew and the corresponding hand movement as an indicator to distinguish typical types of the allergic food. Our initial feasibility study shows that our approach can distinguish six types of food at an accuracy of 89.7% over all four participants’ mixed data. Particularly, our method successfully detected and distinguished typical allergic foods such as burgers (wheat), instant noodles (wheat), peanuts, egg fried rice, and edamame, which can be expected to contribute to not only personal use but also medical usage.
- Open Access
- 12 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 367-370
Phantom Undulations: Remote Physiological Sensing in Abstract Installation Works | Proceedings of the Augmented Humans International Conference 2023
Phantom Undulations is a mixed-media work in which an artist’s physiological data is being used remotely to manipulate the sounds and visuals of an abstract artifact in a gallery setting. This work relies heavily on the concept of showing the artist’s presence or liveness in an abstract and remote manner through changes in the harmony, rhythm, and timbre of a loosely structured soundscape as well as the physical appearance of the artifact. We propose a method of utilizing real time physiological sensing data through a custom built sensing wristband and accompanying software. This system reads the physiological data of the artist and sends it to the Internet, where it can be received by the artifact anywhere on Earth. In addition to the artist’s physiological data, we also offer a way for the audience to incorporate their own data into the work via several sensing wristbands which will accompany the artifact. Through this collaborative process, we wish to invite the audience to join the artist in manipulating the sonic and visual characteristics of this artifact and create a contrapuntally fluid and responsive musical experience.
- 12 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 367-370
Open AccessPhantom Undulations: Remote Physiological Sensing in Abstract Installation Works | Proceedings of the Augmented Humans International Conference 2023
Phantom Undulations is a mixed-media work in which an artist’s physiological data is being used remotely to manipulate the sounds and visuals of an abstract artifact in a gallery setting. This work relies heavily on the concept of showing the artist’s presence or liveness in an abstract and remote manner through changes in the harmony, rhythm, and timbre of a loosely structured soundscape as well as the physical appearance of the artifact. We propose a method of utilizing real time physiological sensing data through a custom built sensing wristband and accompanying software. This system reads the physiological data of the artist and sends it to the Internet, where it can be received by the artifact anywhere on Earth. In addition to the artist’s physiological data, we also offer a way for the audience to incorporate their own data into the work via several sensing wristbands which will accompany the artifact. Through this collaborative process, we wish to invite the audience to join the artist in manipulating the sonic and visual characteristics of this artifact and create a contrapuntally fluid and responsive musical experience.
- Top Cited PapersOpen Access
- 28 February 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 30 (1) , 1-32
Linking Audience Physiology to Choreography
The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this article, we report on the co-design process and research insights from our work integrating physiological sensing and live performance. We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience’s physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.
- 28 February 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer-Human Interaction
- Vol. 30 (1) , 1-32
Top Cited PapersOpen AccessLinking Audience Physiology to Choreography
The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this article, we report on the co-design process and research insights from our work integrating physiological sensing and live performance. We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience’s physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.
- Open Access
- 6 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1
Inner self drawing machine
Besides men and women, people can be neither man nor woman, fluid identity, transgender, and agender. Not only that, in terms of sexual orientation, besides heterosexuals, there are homosexuals, bisexuals, pansexuals, and asexuals as well. However, ignorance and lacking empathetic understanding of those sexual minorities make their lives harsh and suffering. For instance, in the case of transgender people, 28% of them postponed their health care due to discrimination, 19% of them refused medical care altogether, and 28% of them experienced verbal harassment by medical professionals, according to a 2011 national transgender discrimination survey (USA). Unluckily, we are apt to generate a basic understanding of others based on their gender expressions and use such irresponsible and heuristic findings to deal with others. Thus, we decided to create an installation to at least minimize the gap for a moment when the audience can enjoy themselves by watching the drawing performance of their idea portrait (inner-self). Regarding the AI portrait painter, we leverage StyleGAN to generate the continuous gender spectrum of each participant based on their facial features, in which they can choose their ideal gender representation that reflects their inner self the most. Then our AI portrait painter "draws" the selected "self" on the canvas. In general professional painters can detect and draw the most confident and beautiful us, on the other hand, we tend to exaggerate our flaws and ignore our attractive parts. When the drawing performance finishes, the audience can receive the drawing result as a well-printed portrait simultaneously. The printed portrait also works as a souvenir of participating in our exhibition. Our work aims to raise an empathic understanding of the various sexual minorities for a more inclusive, preferable, and sustainable world.
- 6 December 2022
- Published by Association for Computing Machinery (ACM)
- p. 1
Open AccessInner self drawing machine
Besides men and women, people can be neither man nor woman, fluid identity, transgender, and agender. Not only that, in terms of sexual orientation, besides heterosexuals, there are homosexuals, bisexuals, pansexuals, and asexuals as well. However, ignorance and lacking empathetic understanding of those sexual minorities make their lives harsh and suffering. For instance, in the case of transgender people, 28% of them postponed their health care due to discrimination, 19% of them refused medical care altogether, and 28% of them experienced verbal harassment by medical professionals, according to a 2011 national transgender discrimination survey (USA). Unluckily, we are apt to generate a basic understanding of others based on their gender expressions and use such irresponsible and heuristic findings to deal with others. Thus, we decided to create an installation to at least minimize the gap for a moment when the audience can enjoy themselves by watching the drawing performance of their idea portrait (inner-self). Regarding the AI portrait painter, we leverage StyleGAN to generate the continuous gender spectrum of each participant based on their facial features, in which they can choose their ideal gender representation that reflects their inner self the most. Then our AI portrait painter "draws" the selected "self" on the canvas. In general professional painters can detect and draw the most confident and beautiful us, on the other hand, we tend to exaggerate our flaws and ignore our attractive parts. When the drawing performance finishes, the audience can receive the drawing result as a well-printed portrait simultaneously. The printed portrait also works as a souvenir of participating in our exhibition. Our work aims to raise an empathic understanding of the various sexual minorities for a more inclusive, preferable, and sustainable world.
- Open Access
- 29 October 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Experience Visual Impairment via Optical See-through Smart Glasses
As the population ages, many will acquire visual impairments. To improve design for these users, it is essential to build awareness of their perspective during everyday routines. Although several visual impairment simulation toolkits exist in both academia and as commercial products, analog, and static visual impairment simulation tools do not simulate effects with respect to the user’s eye movements. Meanwhile, VR and video see-through-based AR simulation methods are constrained by smaller fields of view when compared with the natural human visual field and also suffer from vergence-accommodation conflict (VAC) which correlates with visual fatigue, headache, and dizziness. This demonstration enables an on-the-go, VAC-free, visually impaired experience by leveraging our optical see-through glasses. The FOV of our glasses is approximately 160 degrees, and participants can experience both losses of central vision and loss of peripheral vision at different severities.
- 29 October 2022
- Published by Association for Computing Machinery (ACM)
- p. 1-2
Open AccessExperience Visual Impairment via Optical See-through Smart Glasses
As the population ages, many will acquire visual impairments. To improve design for these users, it is essential to build awareness of their perspective during everyday routines. Although several visual impairment simulation toolkits exist in both academia and as commercial products, analog, and static visual impairment simulation tools do not simulate effects with respect to the user’s eye movements. Meanwhile, VR and video see-through-based AR simulation methods are constrained by smaller fields of view when compared with the natural human visual field and also suffer from vergence-accommodation conflict (VAC) which correlates with visual fatigue, headache, and dizziness. This demonstration enables an on-the-go, VAC-free, visually impaired experience by leveraging our optical see-through glasses. The FOV of our glasses is approximately 160 degrees, and participants can experience both losses of central vision and loss of peripheral vision at different severities.
- Open Access
- 11 September 2017
- Published by Association for Computing Machinery (ACM)
- p. 141-144
Wearable aura
- 11 September 2017
- Published by Association for Computing Machinery (ACM)
- p. 141-144
Open AccessWearable aura