Objective: Recognizing retinal vessel abnormity is vital to early diagnosis of ophthalmological diseases and cardiovascular events. However, segmentation results are highly influenced by elusive vessels, especially in low-contrast background and lesion region. In this work, we present an end-to-end synthetic neural network, containing a symmetric equilibrium generative adversarial network (SEGAN), multi-scale features refine blocks (MSFRB), and attention mechanism (AM) to enhance the performance on vessel segmentation. Method: The proposed network is granted powerful multi-scale representation capability to extract detail information. First, SEGAN constructs a symmetric adversarial architecture, which forces generator to produce more realistic images with local details. Second, MSFRB are devised to prevent high-resolution features from being obscured, thereby merging multi-scale features better. Finally, the AM is employed to encourage the network to concentrate on discriminative features. Results: On public dataset DRIVE, STARE, CHASEDB1, and HRF, we evaluate our network quantitatively and compare it with state-of-the-art works. The ablation experiment shows that SEGAN, MSFRB, and AM both contribute to the desirable performance. Conclusion: The proposed network outperforms the mature methods and effectively functions in elusive vessels segmentation, achieving highest scores in Sensitivity, G-Mean, Precision, and F1-Score while maintaining the top level in other metrics. Significance: The appreciable performance and computational efficiency offer great potential in clinical retinal vessel segmentation application. Meanwhile, the network could be utilized to extract detail information in other biomedical issues
Radiation therapy is the primary treatment for recurrent nasopharyngeal carcinoma. However, it may induce necrosis of the nasopharynx, leading to severe complications such as bleeding and headache. Therefore, forecasting necrosis of the nasopharynx and initiating timely clinical intervention has important implications for reducing complications caused by re-irradiation. This research informs clinical decision-making by making predictions on re-irradiation of recurrent nasopharyngeal carcinoma using deep learning multi-modal information fusion between multi-sequence nuclear magnetic resonance imaging and plan dose. Specifically, we assume that the hidden variables of model data can be divided into two categories: task-consistency and task-inconsistency. The task-consistency variables are characteristic variables contributing to target tasks, while the task-inconsistency variables are not apparently helpful. These modal characteristics are adaptively fused when the relevant tasks are expressed through the construction of supervised classification loss and self-supervised reconstruction loss. The cooperation of supervised classification loss and self-supervised reconstruction loss simultaneously reserves the information of characteristic space and controls potential interference simultaneously. Finally, multi-modal fusion effectively fuses information through an adaptive linking module. We evaluated this method on a multi-center dataset. and found the prediction based on multi-modal features fusion outperformed predictions based on single-modal, partial modal fusion or traditional machine learning methods.
Abstract Aims We mainly evaluate retinal alterations in Alzheimer's disease (AD) patients, investigate the associations between retinal changes with AD biomarkers, and explore an optimal machine learning (ML) model for AD diagnosis based on retinal thickness. Methods A total of 159 AD patients and 299 healthy controls were enrolled. The retinal parameters of each participant were measured using optical coherence tomography (OCT). Additionally, cognitive impairment severity, brain atrophy, and cerebrospinal fluid (CSF) biomarkers were measured in AD patients. Results AD patients demonstrated a significant decrease in the average, superior, and inferior quadrant peripapillary retinal nerve fiber layer, macular retinal nerve fiber layer, ganglion cell layer (GCL), inner plexiform layer (IPL) thicknesses, as well as total macular volume (TMV) (all p < 0.05). Moreover, TMV was positively associated with Mini‐Mental State Examination and Montreal Cognitive Assessment scores, IPL thickness was correlated negatively with the medial temporal lobe atrophy score, and the GCL thickness was positively correlated with CSF Aβ 42 /Aβ 40 and negatively associated with p‐tau level. Based on the significantly decreased OCT variables between both groups, the XGBoost algorithm exhibited the best diagnostic performance for AD, whose four references, including accuracy, area under the curve, f1 score, and recall, ranged from 0.69 to 0.74. Moreover, the macular retinal thickness exhibited an absolute superiority for AD diagnosis compared with other enrolled variables in all ML models. Conclusion We identified the retinal alterations in AD patients and found that macular thickness and volume were associated with AD severity and biomarkers. Furthermore, we confirmed that OCT combined with ML could serve as a potential diagnostic tool for AD.