Enhanced motion interaction for multimedia applications

In this paper, we consider how low cost wearable sensors may be used to enhance mobile interactions with learning and games multimedia. Unlike camera and single accelerometer based systems, the sensors developed provide measurements for all of the user's limb movements and this data can then be used to recognize what the user is doing anytime anywhere. The movements may then drive a game or may be used in an educative or artistic experience. The aim here is to report on work done using the Hidden Markov Model method for gesture recognition applied as a component within an exemplary Tai Chi training system. The intention is to demonstrate a practical result which could form the basis for other researchers involved in future mobile applications such as dance training, martial arts and sports. We also look at an extension of this work in the field of interactive dance multimedia.