Distributional Validity and Prognostic Power of the National Institutes of Health Stroke Scale in US Administrative Claims Data

Importance Comparative assessment of acute ischemic stroke care quality provided by hospitals in the United States has been hampered by the unavailability of the National Institutes of Health Stroke Scale (NIHSS) in administrative data sets, preventing adequate adjustment for variations in patient case-mix risk. In response to stakeholder concerns, the US Centers for Medicare & Medicaid Services in 2016 implemented optional reporting of NIHSS scores. Objective To analyze the distributional, convergent, and predictive validity of nationally submitted NIHSS values in the National Inpatient Sample. Design, Setting, and Participants This population-based retrospective cross-sectional study took place from October 1 to December 31, 2016. The nationally representative sample included US adults who had ischemic stroke hospitalizations during the first calendar quarter in which optional NIHSS reporting was implemented. Analysis began September 2019. Main Outcomes and Measures Distribution of NIHSS scores, functional independence at discharge, inpatient mortality, and administrative reporting of NIHSS. Results Among 154 165 ischemic stroke hospitalizations during the first 3 months of the reporting policy, NIHSS scores were reported in 21 685 patients (14%) (10 925 women [50.4%]; median [interquartile range] age, 72 [61-82] years). Median (interquartile range) NIHSS score was 4 (2-11), and frequency of severity categories included absent (NIHSS score, 0) in 2080 patients (9.6%), minor (NIHSS score, 1-4) in 8760 patients (40.4%), and severe (NIHSS score, 21-42) in 1930 patients (8.9%). National Institutes of Health Stroke Scale score of 10 or more, an indicator of possible large vessel occlusions, was present in 6290 patients (29%). Presenting NIHSS score was higher in very elderly patients (age ≥80 y) and women and also in patients receiving endovascular thrombectomy vs intravenous thrombolysis alone vs no reperfusion therapy (median [interquartile range], 17 [12-22] vs 6 [4-12] vs 4 [2-9], respectively) (P  Conclusions and Relevance In the initial national optional reporting period in the United States, NIHSS scores were reported in nearly 1 in 7 ischemic stroke hospitalizations. The distribution of NIHSS scores was similar to that from narrow population-based studies and registries, and NIHSS scores were powerfully associated with discharge outcome, supporting the validity and potential to aid care quality assessment.