Deep Model with Siamese Network for Viable and Necrotic Tumor Regions Assessment in Osteosarcoma.

PURPOSE To achieve automatic classification of viable and necrotic tumor regions in osteosarcoma, most of the existing deep learning methods can only design a simple model to prevent overfitting on small datasets, which leads to the weak ability of extracting image features and low accuracy of the models. In order to solve the above problem, a Deep model with Siamese Network (DS-Net) was designed in this paper. METHODS The DS-Net constructed on the basis of full convolutional networks is composed of an Auxiliary Supervision Network (ASN) and a classification network. The construction of the ASN based on the Siamese network aims to solve the problem of a small training set (the main bottleneck of deep learning in medical images). It uses paired data as input and updates the network through combined labels. The classification network uses the features extracted by the ASN to perform accurate classification. RESULTS Pathological diagnosis is the most accurate method to identify osteosarcoma. However, due to intra-class variation and inter-class similarity, it is challenging for pathologists to accurately identify osteosarcoma. Through the experiments on hematoxylin and eosin (H&E) stained osteosarcoma histology slides, the DS-Net we constructed can achieve an average accuracy of 95.1%. Compared with existing methods, the DS-Net performs best in the test data set. CONCLUSIONS The DS-Net we constructed can not only effectively realize the histological classification of osteosarcoma, but also be applicable to many other medical image classification tasks affected by small data sets.