User experience enhancing filter for a Webcam based human computer interaction

In this paper, we present a physics filter which can enhance the user experience of human computer interaction applications. We demonstrate the filter through an interaction system with head gestures and movements. Users interact with the computer through the wink detection function, implemented by eye brightness intensity analysis, and head tracking function, implemented by a facial landmark detector. However, both intensity and facial landmark data are unstable in temporal domain, which deteriorates user experience. Our proposed physics filter is capable of enhancing stability with minimizing latency. This filter can be used in various interaction applications where data stabilization is required.