Hyperspectral Image Classification Based on Deep Deconvolution Network With Skip Architecture

Convolution neural network (CNN) utilizes alternating convolutional and pooling layers to learn representative spatial information when the training samples are sufficient. However, for pixelwise classification of hyperspectral image, some important information is neglected by CNN, such as the erased information by the pooling operation and the appearance information from lower layers. Moreover, the lack of training samples is a common situation in remote sensing area, which afflicts CNN with overfitting problem. To address the aforementioned issues, this paper designs an end-to-end deconvolution network with skip architecture to learn the spectral–spatial features. The proposed network starts with two branches, i.e., the spatial branch and spectral branch. In the spatial branch, a band selection layer is designed to reduce parameters and remit the overfitting problem, unpooling and deconvolution operations are utilized to recover the erased information of the pooling layers and learn pixelwise spatial representation hierarchically, and the skip architecture is constructed for merging the deep semantic information with the shallow appearance information. In the spectral branch, a contextual deep network is employed for learning deep spectral features. Experimental results on three benchmark data sets reveal the competitive performance of the proposed approach over several related methods.