Artificial intelligence-based analysis for immunohistochemistry staining of immune checkpoints to predict resected non-small cell lung cancer survival and relapse

Background Conventional analysis of single-plex chromogenic immunohistochemistry (IHC) focused on quantitative but spatial analysis. How immune checkpoints localization related to non-small cell lung cancer (NSCLC) prognosis remained unclear. Methods Here, we analyzed ten immune checkpoints on 1,859 tumor microarrays (TMAs) from 121 NSCLC patients and recruited an external cohort of 30 NSCLC patients with 214 whole-slide IHC. EfficientUnet was applied to segment tumor cells (TCs) and tumor-infiltrating lymphocytes (TILs), while ResNet was performed to extract prognostic features from IHC images. Results The features of galectin-9, OX40, OX40L, KIR2D, and KIR3D played an un-negatable contribution to overall survival (OS) and relapse-free survival (RFS) in the internal cohort, validated in public databases (GEPIA, HPA, and STRING). The IC-Score and Res-Score were two predictive models established by EfficientUnet and ResNet. Based on the IC-Score, Res-Score, and clinical features, the integrated score presented the highest AUC for OS and RFS, which could achieve 0.9 and 0.85 in the internal testing cohort. The robustness of Res-Score was validated in the external cohort (AUC: 0.80-0.87 for OS, and 0.83-0.94 for RFS). Additionally, the neutrophil-to-lymphocyte ratio (NLR) combined with the PD-1/PD-L1 signature established by EfficientUnet can be a predictor for RFS in the external cohort. Conclusions Overall, we established a reliable model to risk-stratify relapse and death in NSCLC with a generalization ability, which provided a convenient approach to spatial analysis of single-plex chromogenic IHC.