Self-Aware LiDAR Sensors in Autonomous Systems using a Convolutional Neural Network

Abstract Autonomous systems, as found in autonomous driving and highly automated production systems, require an increased reliability in order to achieve their high economic potential. Self-aware sensors are a key component in highly reliable autonomous systems. In this paper we highlight a proof of concept (PoC) of a deep learning method that enables a LiDAR (Light detection and ranging) sensor to detect functional impairment. More specifically, a deep convolutional neural network (CNN) is developed and trained with labelled LiDAR data in the form of point clouds to classify the degree of impairment of its functionality. The results are statistically significant and can be regarded as a general classifier for objects within LiDAR data, applied to selected cases of sensor impairment. In detecting impairment and evaluating the correctness of the captured data, the sensor gains a basic form of self-awareness. The presented methods and insights pave the way for improved safety of autonomous systems by the means of more sophisticated “self-aware” neural networks.