The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements
Authors:
Open Access
- 20 September 2022
- journal article
- research article
- Published by Hindawi Limited in Computational Intelligence and Neuroscience
- Vol. 2022, 1-12
Abstract
The Fusion Application of Deep Learning Biological Image Visualization Technology and Human-Computer Interaction Intelligent Robot in Dance Movements: The paper aims to apply the deep learning-based image visualization technology to extract, recognize, and analyze human skeleton movements and evaluate the effect of the deep learning-based human-computer interaction (HCI) system. Dance education is researched. Firstly, the Visual Geometry Group Network (VGGNet) is optimized using Convolutional Neural Network (CNN). Then, the VGGNet extracts the human skeleton movements in the OpenPose database. Secondly, the Long Short-Term Memory (LSTM) network is optimized and recognizes human skeleton movements. Finally, an HCI system for dance education is designed based on the extraction and recognition methods of human skeleton movements. Results demonstrate that the highest extraction accuracy is 96, and the average recognition accuracy of different dance movements is stable. The effectiveness of the proposed model is verified. The recognition accuracy of the optimized F-Multiple LSTMs is increased to 88.9, suitable for recognizing human skeleton movements. The dance education HCI systems interactive accuracy built by deep learning-based visualization technology reaches 92; the overall response time is distributed between 5.1s and 5.9s. Hence, the proposed model has excellent instantaneity. Therefore, the deep learning-based image visualization technology has enormous potential in human movement recognition, and combining deep learning and HCI plays a significant role.Keywords
This publication has 58 references indexed in Scilit:
- Modelling of Static and Moving Objects: Digitizing Tangible and Intangible Cultural Heritage2017
- Image contrast enhancement using fuzzy clustering with adaptive cluster parameter and sub-histogram equalizationDigital Signal Processing, 2017
- The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAMThe International Journal of Robotics Research, 2017
- Trajectory aligned features for first person action recognitionPattern Recognition, 2017
- Transforming Intangible Folkloric Performing Arts into Tangible Choreographic Digital Objects: The Terpsichore Approach2017
- Power-Efficient Accelerator Design for Neural Networks Using Computation ReuseIEEE Computer Architecture Letters, 2017
- Transfer Learning with Convolutional Neural Networks for Classification of Abdominal Ultrasound ImagesJournal of Digital Imaging, 2016
- The i-Treasures Intangible Cultural Heritage dataset2016
- Folk Dance Evaluation Using Laban Movement AnalysisJournal on Computing and Cultural Heritage, 2015
- Soft computing based intention reading techniques as a means of human-robot interaction for human centered systemSoft Computing, 2003