Virtual Bridge: AR-Based Mobile Interaction for Easy Multimedia Control of Remote Home Devices

This paper proposes an interaction for controlling multimedia contents of remote devices using a mobile device based on AR technology. Using a real-time object recognition method, home devices detected by the camera of a mobile device are displayed on the camera preview screen along with the thumbnails of their own multimedia contents around the recognized positions. A user may drag a multimedia content which he or she wants to play, and drop it onto another target home device which he or she wants to play the content through. The user study showed that the proposed interaction expects higher usability since once a home device is registered with its device name when registering its image shown on the mobile camera for the object recognition, this matching process is no longer necessary when a user controls the device through the mobile device.