Utilizing social virtual reality robot (V2R) for music education to children with high-functioning autism

Virtual Reality (VR) technology is a growing technology that has been used in various fields of psychology, education, and therapy. One group of potential users of VR are children with autism who need education and have poor social interactions; this technology could help them improve their social skills through real-world simulation. In this study, we evaluated the feasibility of conducting virtual music education programs with automatic assessment system for children with autism at treatment/research centers without the need to purchase a robot, resulting in the possibility of offering schedules on a larger scale and at a lower cost. Intervention sessions were conducted for five children with high-functioning autism ranging in age from 6 to 8 years old during 20 weeks which includes a baseline session, a pre-test, training sessions, a post-test, and a follow-up test. Each music education sessions involved teaching different notes and pieces of music according to the child’s cooperation, accuracy, and skill level utilizing virtual reality robots and virtual musical instruments. Actually, by analysis of psychological tests, and questionnaires conducted by a psychologist, we observe slight improvements in cognitive skills because of the ceiling effect. Nevertheless, the effectiveness of the proposed method was proved by conducting statistical analysis on the child’s performance data during the music education sessions which were obtained by using both video coding and the proposed automatic assessment system. Consequently, a general upward trend in the musical ability of participants was shown to occur in these sessions, which warrants future studies in this field.