Fully Automated Brain Tumor Segmentation and Survival Prediction of Gliomas using Deep Learning and MRI

Tumor segmentation of magnetic resonance (MR) images is a critical step in providing objective measures of predicting aggressiveness and response to therapy in gliomas. It has valuable applications in diagnosis, monitoring, and treatment planning of brain tumors. The purpose of this work was to develop a fully automated deep learning method for brain tumor segmentation and survival prediction. Well curated brain tumor cases with multi-parametric MR Images from the BraTS2019 dataset were used. A three-group framework was implemented, with each group consisting of three 3D-Dense-UNets to segment whole tumor (WT), tumor core (TC) and enhancing tumor (ET). This method was implemented to decompose the complex multi-class segmentation problem into individual binary segmentation problems for each sub-component. Each group was trained using different approaches and loss functions. The output segmentations of a particular label from their respective networks from the 3 groups were ensembled and post-processed. For survival analysis, a linear regression model based on imaging texture features and wavelet texture features extracted from each of the segmented components was implemented. The networks were tested on the BraTS2019 validation dataset including 125 cases for the brain tumor segmentation task and 29 cases for the survival prediction task. The segmentation networks achieved average dice scores of 0.891, 0.809 and 0.774 for WT, TC and ET respectively. The survival prediction network achieved an accuracy score of 0.44 and mean squared error (MSE) of 109543. This method could be implemented as a robust tool to assist clinicians in primary brain tumor management and follow-up.