GCGeorge Chernyshov

George Chernyshov

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


George Chernyshov has a total of 38 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Collective Somatic Counterpoint

    by Danny Hynds, George Chernyshov, Hua Ma, Giulia Barbareschi, Chihiro Sato, Shinya Fujii

  • Open Access

    "Speech is Silver, Silence is Golden " Analyzing Micro-communication Strategies between Visually Impaired Runners and their Guides

    by Giulia Barbareschi, Tarika Kumar, Christopher Changmok Kim, George Chernyshov, Kai Kunze

    Running and jogging are popular activities for many visually impaired individuals thanks to the relatively low entry barriers. Research in HCI and beyond has focused primarily on leveraging technology to enable visually impaired people to run independently. However, depending on their residual vision and personal preferences, many chose to run with a sighted guide. This study presents a comprehensive analysis of the partnership between visually impaired runners and sighted guides. Using a combination of interaction and thematic analysis on video and interview data from 6 pairs of runners and guides, we unpack the complexity and directionality of three layers of vocal communication (directive, contextual, and recreational) and distinguish between intentional and unintentional corporeal communication. Building on the understanding of the importance of synchrony we also present some exploratory data looking at physiological synchrony between 2 pairs of runners with different level of experience and articulate recommendations for the HCI community.


  • Open Access

    Innermost Echoes: Integrating Real-Time Physiology into Live Music Performances

    by Danny Hynds, George Chernyshov, Dingding Zheng, Aoi Uyama, Juling Li, Kozue Matsumoto, Michael Pogorzhelskiy, Kai Kunze, Jamie A Ward, Kouta Minamizawa


  • Open Access

    First Bite/Chew: distinguish different types of food by first biting/chewing and the corresponding hand movement

    by Junyu Chen, Xiongqi Wang, Juling Li, George Chernyshov, Yifei Huang, Kai Kunze, Jing Huang, Thad Starner, Qing Zhang

    Imbalanced food intake contributes to various diseases, such as obesity, diabetes, high blood pressure, high cholesterol, heart disease, and type-2 diabetes. At the same time, food intake monitoring systems play a significant role in the treatment. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. The challenges that remain are social acceptance, lightweight, easy to use, and inexpensive. Our method leverages two 6-axe Inertial Measurement Units (IMU) on the glasses’ leg and the wrist to detect the user’s food intake activities using a machine learning capable Micro Controller Unit (MCU). We introduced the concept of the first bite/chew, which is a stable and reliable indicator to distinguish food types. Our implementation results show that our method can distinguish seven kinds of food at an accuracy of 93.26% (average) over all four participants.


  • Open Access

    First Bite/Chew: distinguish typical allergic food by two IMUs

    by Juling Li, Xiongqi Wang, Junyu Chen, Thad Starner, George Chernyshov, Jing Huang, Yifei Huang, Kai Kunze, Qing Zhang

    Eating or overtaking allergic foods may cause fatal symptoms or even death for people with food allergies. Most current food intake tracking methods are camera-based, on-body sensor-based, microphone based, and self-reported. However, challenges that remain are allergic food detection, social acceptance, lightweight, easy to use, and inexpensive. Our approach leverages the first bite/chew and the corresponding hand movement as an indicator to distinguish typical types of the allergic food. Our initial feasibility study shows that our approach can distinguish six types of food at an accuracy of 89.7% over all four participants’ mixed data. Particularly, our method successfully detected and distinguished typical allergic foods such as burgers (wheat), instant noodles (wheat), peanuts, egg fried rice, and edamame, which can be expected to contribute to not only personal use but also medical usage.

  • Open Access

    Phantom Undulations: Remote Physiological Sensing in Abstract Installation Works | Proceedings of the Augmented Humans International Conference 2023

    by Danny Hynds, Dingding Zheng, Yilin Zhang, Hua Ma, Kirill Ragozin, George Chernyshov, Jamie A. Ward, Tatsuya Saito, Kai Kunze, Kouta Minamizawa

    Phantom Undulations is a mixed-media work in which an artist’s physiological data is being used remotely to manipulate the sounds and visuals of an abstract artifact in a gallery setting. This work relies heavily on the concept of showing the artist’s presence or liveness in an abstract and remote manner through changes in the harmony, rhythm, and timbre of a loosely structured soundscape as well as the physical appearance of the artifact. We propose a method of utilizing real time physiological sensing data through a custom built sensing wristband and accompanying software. This system reads the physiological data of the artist and sends it to the Internet, where it can be received by the artifact anywhere on Earth. In addition to the artist’s physiological data, we also offer a way for the audience to incorporate their own data into the work via several sensing wristbands which will accompany the artifact. Through this collaborative process, we wish to invite the audience to join the artist in manipulating the sonic and visual characteristics of this artifact and create a contrapuntally fluid and responsive musical experience.


  • Top Cited Papers
    Open Access

    Linking Audience Physiology to Choreography

    by Jiawen Han, George Chernyshov, Moe Sugawa, Dingding Zheng, Danny Hynds, Taichi Furukawa, Marcelo Padovani Macieira, Karola Marky, Kouta Minamizawa, Jamie A. Ward, et al.

    The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this article, we report on the co-design process and research insights from our work integrating physiological sensing and live performance. We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience’s physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.


  • Open Access

    Inner self drawing machine

    by Qing Zhang, Fan Xie, Yifei Huang, Yun Suen Pai, George Chernyshov, Jing Huang, Xiongqi Wang, Jamie A Ward, Kai Kunze

    Besides men and women, people can be neither man nor woman, fluid identity, transgender, and agender. Not only that, in terms of sexual orientation, besides heterosexuals, there are homosexuals, bisexuals, pansexuals, and asexuals as well. However, ignorance and lacking empathetic understanding of those sexual minorities make their lives harsh and suffering. For instance, in the case of transgender people, 28% of them postponed their health care due to discrimination, 19% of them refused medical care altogether, and 28% of them experienced verbal harassment by medical professionals, according to a 2011 national transgender discrimination survey (USA). Unluckily, we are apt to generate a basic understanding of others based on their gender expressions and use such irresponsible and heuristic findings to deal with others. Thus, we decided to create an installation to at least minimize the gap for a moment when the audience can enjoy themselves by watching the drawing performance of their idea portrait (inner-self). Regarding the AI portrait painter, we leverage StyleGAN to generate the continuous gender spectrum of each participant based on their facial features, in which they can choose their ideal gender representation that reflects their inner self the most. Then our AI portrait painter "draws" the selected "self" on the canvas. In general professional painters can detect and draw the most confident and beautiful us, on the other hand, we tend to exaggerate our flaws and ignore our attractive parts. When the drawing performance finishes, the audience can receive the drawing result as a well-printed portrait simultaneously. The printed portrait also works as a souvenir of participating in our exhibition. Our work aims to raise an empathic understanding of the various sexual minorities for a more inclusive, preferable, and sustainable world.


  • Open Access

    Experience Visual Impairment via Optical See-through Smart Glasses

    by Qing Zhang, Xiongqi Wang, Thad Starner, Yifei Huang, George Chernyshov, Giulia Barbareschi, Yun Suen Pai, Jing Huang, Junichi Yamaoka, Jamie Ward, et al.

    As the population ages, many will acquire visual impairments. To improve design for these users, it is essential to build awareness of their perspective during everyday routines. Although several visual impairment simulation toolkits exist in both academia and as commercial products, analog, and static visual impairment simulation tools do not simulate effects with respect to the user’s eye movements. Meanwhile, VR and video see-through-based AR simulation methods are constrained by smaller fields of view when compared with the natural human visual field and also suffer from vergence-accommodation conflict (VAC) which correlates with visual fatigue, headache, and dizziness. This demonstration enables an on-the-go, VAC-free, visually impaired experience by leveraging our optical see-through glasses. The FOV of our glasses is approximately 160 degrees, and participants can experience both losses of central vision and loss of peripheral vision at different severities.

  • Open Access

    Wearable aura

    by Dingding Zheng, Laura Lugaresi, George Chernyshov, Benjamin Tag, Masa Inakage, Kai Kunze