Automatic detection of erosions and ulcerations in wireless capsule endoscopy images based on a deep convolutional neural network

Background and Aims Although erosions and ulcerations are the most common small-bowel abnormalities found on wireless capsule endoscopy (WCE), a computer-aided detection method has not been established. We aimed to develop an artificial intelligence system with deep learning to automatically detect erosions and ulcerations in WCE images. Methods We trained a deep convolutional neural network (CNN) system based on a Single Shot Multibox Detector, using 5360 WCE images of erosions and ulcerations. We assessed its performance by calculating the area under the receiver operating characteristic curve and its sensitivity, specificity, and accuracy using an independent test set of 10,440 small-bowel images including 440 images of erosions and ulcerations. Results The trained CNN required 233 seconds to evaluate 10,440 test images. The area under the curve for the detection of erosions and ulcerations was 0.958 (95% confidence interval [CI], 0.947-0.968). The sensitivity, specificity, and accuracy of the CNN were 88.2% (95% CI, 84.8%-91.0%), 90.9% (95% CI, 90.3%-91.4%), and 90.8% (95% CI, 90.2%-91.3%), respectively, at a cut-off value of 0.481 for the probability score. Conclusions We developed and validated a new system based on CNN to automatically detect erosions and ulcerations in WCE images. This may be a crucial step in the development of daily-use diagnostic software for WCE images to help reduce oversights and the burden on physicians.