Crossing the Streams: Fuzz testing with user input

Testing is an integral part of all software systems. In human/machine teaming systems, user inputs must be included in testing. For interactive streaming analytic systems, the user inputs must be contextualized in the dynamic data environment. We introduce a test harness for handling interacting human and machine data streams within interactive streaming analytic systems. We define the four key processes that comprise the test harness: Clock, Journal, Replay, and Database. We define a working library of replay patterns, which are modified human input streams. These can be leveraged to characterize the system behaviors and performance. Implications and applications of the test harness for test and evaluation of human/machine systems are identified. Test harness introduces a modeling and simulation approach for broader test and evaluation of human/machine systems to bootstrap costly user studies in support of validation and verification efforts.