Virtual Simulation of Dance by Integrating VR Technology and Motion Capture Technology

Abstract

For the virtual simulation technology is difficult to meet the needs of dance movement interactivity, multi-person collaboration and real-time, a virtual dance simulation method combining virtual reality technology and motion capture technology is proposed. By using motion capture technology to capture dancers' movements and transform them into 3D movements of the virtual environment. Real-time feedback and interaction are then used to provide effective learning and performance tools for YH. The model was trained using Human3.6M dataset and obtained 81% accuracy on the self-built dataset. The validation accuracy on NTU RGB+D dataset and Kinetics dataset were 80% and 55% respectively. The accuracy of the proposed method of the study increased by 14.89%, 7.99% and 19.34% respectively compared to other methods. The accuracy of the study proposed dance virtual simulation method was 92% for all movement tests. The results show that the dance virtual simulation method designed by the study based on the fusion of virtual simulation technology and motion capture technology can achieve the interactivity of the limbs and improve the accuracy of the recognition of dance movements, which has a positive application value in the field of virtual dance experience. This study is expected to promote the further development of virtual dance experience and provide more opportunities and innovative space for dance enthusiasts and professional dancers. The study shows that this research is expected to promote the further development of virtual dance experience, providing more opportunities and innovation space for dance lovers and professional dancers.