Formen kognitiver Belastung bei der Bewältigung technologiebasierter authentischer Testaufgaben – eine Validierungsstudie zur Abbildung von beruflicher Kompetenz

According to Messick (1989; 1995) a valid assessment of competencies is given if integrative empirical evidence for adequate proficiency estimations exists. A source of an incorrect estimation of skills emerges by activating unintended cognitive capacities (loads). 18 authentic test tasks were constructed technology-based in order to assess intrapreneurship competencies on the basis of the Cognitive Load Theory (Sweller 2004; van Merrienboer/Kirschner 2013). In this design process, we tried to minimize undesired (extraneous cognitive load: = ECL) loads in the platform and to systematically vary construct-relevant (intrinsic cognitive load: = ICL) loads in the test tasks by linking theory-based ICL-criteria. By combining the analysis of verbal protocols and the measured performance of 26 apprentices, this study examines to what extent ICL and ECL occur as intended while solving the test tasks. The validation follows a Mixed Method Design: Deviations from intended ICL and ECL are identified task-based by conducting variance-analytical and graphical tests; qualitative analyses enable explanation patterns for the deviations. With respect to a large number of tasks the study shows results which are conform to the expectations. Few deviations and the corresponding explanation patterns for ICL and ECL deliver precise proposals for revisions on the existing test instrument. Furthermore, they provide pioneering recommendations for the construction of technology-based authentic test tasks.