Automated classification of hepatocellular carcinoma differentiation using multiphoton microscopy and deep learning

: In the case of hepatocellular carcinoma (HCC) samples, classification of differentiation is crucial for determining prognosis and treatment strategy decisions. However, a label-free and automated classification system for HCC grading has not been yet developed. Hence, in this study, we demonstrate the fusion of multiphoton microscopy and a deep-learning algorithm for classifying HCC differentiation to produce an innovative computer-aided diagnostic method. Convolutional neural networks based on the VGG-16 framework were trained using 217 combined two-photon excitation fluorescence and second-harmonic generation images; the resulting classification accuracy of the HCC differentiation grade was over 90%. Our results suggest that a combination of multiphoton microscopy and deep learning can realize label-free, automated methods for various tissues, diseases and other related classification problems.