Development of Kodály Hand Sign Educational Tools using Multi-Layer Perceptron

Hand signs have been recognized to be useful in enhancing the effectiveness of music learning in music education. In particular, Kodaly hand signs based on the Kodaly teaching method are widely used around the world because their effectiveness has been recognized. The purpose of this study is to implement a hand sign recognition system using a neural network and to present a method that can systematically learn hand signs. Device-based systems were considered for portability, activity, and economy. In addition, the introduction of additional filtering to the neural network input was proposed to improve portability and recognition rate to small devices.