Measuring knowledge: investigative research into the quantification of performance within a contextual multi-source PED fusion process
2013
Most intelligence analysts currently use Information Products (IP) from multiple sources with very different
characteristics to perform a variety of intelligence tasks. In order to maximize the analysts’ efficacy (and ultimately
provide intelligent automation), it is important to understand how and what each IP within the set of IPs contributes
to the accuracy and validity of the analytic result. This paper describes initial research toward the development of a
scale, analogous to the National Imagery Interpretability Scale (NIIRS), which will measure the knowledge contribution
of each of the multi-source IPs, as well as measuring the extent to which the IP set as a whole meets the enduser’s
intelligence need – which is actionable knowledge. This scale, the Knowledge-NIIRS (KnIIRS), when
completed, will support the measurement of the quality and quantity of information gained through multi-source IP
fusion and enables the development of smart (automated) tools for analysts using the next generation of PED workstations.
The results of this initial study indicate that analysts are capable of making judgments that reflect the
“value” of fused information, and that the judgments they make vary along at least two dimensions. Furthermore,
there are substantial and significant differences among analysts in how they make these judgments that must be
considered for further scale development. We suggest that the KnIIRS objectives and its derived understandings
offer important and critical insights to enable automation that will achieve the goal to deliver actionable knowledge.
Keywords:
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
10
References
0
Citations
NaN
KQI