Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches

Binocular depth estimation is a hot research topic in computer vision. Traditional methods need high precision camera calibration and key point matching, but the results are not ideal. In this paper, we introduce an approach of binocular depth estimation method based on deep learning. A new convolutional neural network is designed, which consists of two sub-networks. The first sub-network is a deep network with Siamese branches and 3D convolutional layer, it learns parallax and global information and generates a global depth estimation result in low resolution. The second is a fully convolutional deep network, which reconstructions the depth map to original resolution. The two sub-networks are connected by a pool pyramid. Experiments are taken on the Middlebury Stereo Dataset show that the proposed method can generate much more accurate depth image than traditional methods.