Scoring Concept Maps: An Expert Map‐Based Scheme Weighted for Relationships

The use of student-constructed concept maps in assessment is congruent with the changing emphases set forth by the National Science Education Standards. Authorities have expressed concern about concept map scoring systems and their associated validity and reliability. They favor methods that employ expert/criterion maps as referents and emphasize the use of accurate concept relationships in deriving scores, which have been found to correlate with performance on standardized tests. In this study, student constructed concept maps (n= 17) that emerged from post-instructional interviews about chlorofluorocarbons were scored against a teacher-expert map using a scheme weighted for relationships. Interrater reliability for the scoring scheme was high (r= .959). Students' map scores correlated highly with their scores on the California Achievement Test component total (r= .729) and moderately with their Pathfinder index (r= .474), the latter believed to be an excellent measure of structural knowledge. A revised map score, derived only from relationships containing one or more of the concepts employed in Pathfinder analysis, was a statistically significant (p= .031) predictor of the Pathfinder index. The findings of this study support the recommendations of others to use expert referents and emphasize concept relationships in assessing concept maps.