Integrating performer into a real-time augmented reality performance spatially by using a multi-sensory prop

The authors developed a system for augmenting live performances where the performer can drive the rendered background image via an infrared LED transmitter prop. A multi-sensory prop was designed to aid the position tracking of performer on large scale stage. An infrared LED and a wireless circuit were integrated into the prop, it could be captured by an infrared camera and host computer. It could also trigger the interaction between performer and virtual objects or visual effects, then the virtual objects or special effects will be matched with the position of real performer and displayed on the background large screen to make a real-time augmented live performance.