Study on Implicit Associations between Gestures and Commands

Objective: This study presents a method to investigate implicit associations between gestures and commands when people use gestures to control a device. Background: Selecting motions for gesture interaction is critical for its usability. The design of motion is, however, limited by the technology utilized in motion recognition system. Therefore, proposing a gesture considering technology limitation is necessary. Method: Thirty nine gestures for the depth camera recognition system were listed, and 30 commands for smart TV control were identified. For each gesture, 30 participants rated top three commands which would match up with the given gesture. Results: Agreement scores were calculated for each gesture, and the association between the gesture element and the command element were calculated. Conclusion: Complex gestures showed low agreement scores, and the association matrix was calculated. Application: This study could be applied to any device considered to adopt gesture interaction for device control.