Interaction with Objects and Humans Based on Visualized Flow Using a Background-Oriented Schlieren Method

Air flow is a ubiquitous phenomenon that can provide important insights to extend our perceptions and intuitive interactions with our surroundings. This study aimed to explore interaction methods based on flow visualization using background-oriented schlieren (BOS) in three case studies. Case 1 involved visualization of the airflow around humans or objects, which demonstrated that visualized flow provides meaningful information about the human or object under investigation. Case 2 involved the testing of a prototype sensor, where visualized flow was used to sense fine airflow. Stabilization of the flow was required for operation of the sensor. Case 3 involved the testing of a prototype system to investigate the use of flow as an input interface for playing a video game. The system did not operate as expected, but the design of the flow can be improved. Overall, interaction using flow visualization allows for the perception of air flow in a broad sense, and presents new opportunities in the field of human computer interaction.