Mute robot: cooperative gameplay through body language communication

Body language is an expressive form of communication that transcends language barriers, and can range from subtle to outrageous. We have designed Mute Robot, a game in which 2 players must cooperate to solve a series of puzzle challenges by communicating through body language only. Kinect devices are used to capture players' posture and movement, which are then shared between two partners who are playing at two different physical locations. Mute Robot is designed to connect people across the globe who otherwise would not be able to communicate via a common language. Our 16-person user study showed that body language is practical and entertaining, with 2/3 of the players reported that they could understand the other player's body language well.