Reader performance in visual assessment of breast density using visual analogue scales: are some readers more predictive of breast cancer?

Mammographic breast density is one of the strongest risk factors for breast cancer, and is used in risk prediction and for deciding appropriate imaging strategies. In the Predicting Risk Of Cancer At Screening (PROCAS) study, percent density estimated by two readers on Visual Analogue Scales (VAS) has shown a strong relationship with breast cancer risk when assessed against automated methods. However, this method suffers from reader variability. This study aimed to assess the performance of PROCAS readers using VAS, and to identify those most predictive of breast cancer. We selected the seven readers who had estimated density on over 6,500 women including at least 100 cancer cases, analysing their performance using multivariable logistic regression and Receiver Operator Characteristic (ROC) analysis. All seven readers showed statistically significant odds ratios (OR) for cancer risk according to VAS score after adjusting for classical risk factors. The OR was greatest for reader 18 at 1.026 (95% Cl 1.018-1.034). Adjusted Area Under the ROC Curves (AUCs) were statistically significant for all readers, but greatest for reader 14 at 0.639. Further analysis of the VAS scores for these two readers showed reader 14 had higher sensitivity (78.0% versus 42.2%), whereas reader 18 had higher specificity (78.0% versus 46.0%). Our results demonstrate individual differences when assigning VAS scores; one better identified those with increased risk, whereas another better identified low risk individuals. However, despite their different strengths, both readers showed similar predictive abilities overall. Standardised training for VAS may improve reader variability and consistency of VAS scoring.