Job Knowledge Test Design: A Cognitively-Oriented Approach

Abstract : This report describes the application of cognitive methods to the measurement of performance using tests of job knowledge. The research goal is to improve the usefulness of job knowledge tests as a proxy for hands-on performance. The approach involves employing cognitive science methods to identify important knowledge content relevant to successful job performance, which may be missed by existing test development procedures. In an application to testing land navigation knowledge of U.S. Marines, the results suggest that cognitively-oriented job knowledge tests show improved correspondence with hands-on measures of performance, compared to existing content-oriented test development procedures. These results appear promising for the economical adaptation of cognitive methods to applications in performance measurement, training assessment, and training program evaluation.