Unifying Voice And Hand Indication Of Spatial Layout

A method of unifying voice and hand pointing information to indicate an object on a map is proposed. Our approach is to represent two different kinds of information in a unified form and merge their information. Voice indications are transformed into a set of terms of an object's attributes and relationships of objects with associated values which show their ambiguity. A hand pointing gesture is also transformed into a term which represents that one of a number or objects pointed at takes priority. IMAGE can identify an object indicated with voice and hand pointing by selecting the object which primarily satisfies the combined effectiveness of the relationships and terms.