Investigating the Validity of Performance and Objective Workload Evaluation Research (POWER)

Abstract : Performance and Objective Workload Evaluation Research (POWER) software was developed to provide objective measures of ATC taskload and performance. POWER uses data extracted from National Airspace System (NAS) System Analysis Recording (SAR) files to compute a set of objective measures. A study was conducted to investigate the relationship of POWER measures with measures of sector complexity, controller workload, and performance. Sixteen instructors from the FAA Academy in Oklahoma City, OK, watched eight traffic samples from four en route sectors in the Kansas City Center using the Systematic Air Traffic Operations Research Initiative (SATORI) system. POWER measures were computed using the same data. Participants made three estimates of the workload experienced by radar controllers and provided two types of assessments of their performance. Sector complexity was determined using information about sector characteristics and the traffic samples. Some POWER measures were related to sector complexity and controller workload, but the relationship with performance was less clear. While this exploratory study provides important information about the POWER measures, additional research is needed to better understand these relationships. When the properties and limitations of these measures are better understood, they may then be used to calculate baseline measures for the current National Airspace System.