Multimodal interactions, virtual reality and 360 movies: applications using Wavefield synthesis

We present a report covering our preliminary research on the use of wavefield synthesis WFS in a multimodal context. Traditionally, WFS has been used as a way to faithfully reproduce auditory experiences. To our knowledge, little research has tried to understand how to gesturally control WFS. Moreover, there are no applications combining WFS and virtual reality video productions. In this paper, we are interested in exploring the applications of WFS in the context of gestural control and 360 video production. We present three projects performed by students at Aalborg University Copenhagen that explore these directions.