Spectrally Tunable Neural Network-Assisted Segmentation of Microneurosurgical Anatomy

Background: Distinct tissue types are differentiated based on the surgeon’s knowledge and subjective visible information, typically assisted with white-light intraoperative imaging systems. Narrow-band imaging (NBI) assists in tissue identification and enables automated classifiers, but many anatomical details moderate computational predictions and cause bias. Especially tissues’ light-source dependent optical characteristics, anatomical location and potentially hazardous microstructural changes such as peeling have been overlooked in previous literature. Methods: Narrow-band images of five (n=5) facial nerves (FN) and internal carotid arteries (ICA) were captured from freshly frozen temporal bones. The FNs were split into intracranial and intratemporal samples and ICAs adventitia peeled from the distal end. Three-dimensional (3D) spectral data was captured by a custom-built liquid crystal tunable filter (LCTF) spectral imaging system. We investigated the normal variance between the samples and utilized descriptive and machine learning analysis on the image stack hypercubes. Results: Reflectance between intact and peeled artery in lower wavelength domains between 400–576 nm was significantly different (p<.05). Proximal FN could be differentiated from distal in a higher range 490–720 nm (p<.001). ICA with intact tunica differed from proximal FN nearly thorough the VIS-range; 412–592 nm (p<.001), 664–720 nm (p<.05) as did its distal counterpart; 422–720 nm (p<.001). Availed U-net algorithm classified 90,93% of the pixels correctly in comparison to tissue margins delineated by a specialist. Conclusion: Selective NBI represents a promising method for assisting tissue identification and computational segmentation of surgical microanatomy. Further multidisciplinary research is required for its clinical applications and intraoperative integration.