FPGA-based real time video stitching method for video surveillance

Abstract A field programable gate array (FPGA) based video stitching method is proposed in this paper, which can improve the real-time performance of the video surveillance system. In our method, a two-stage seam searching algorithm based on enhanced dynamic programing is presented, which can obtain satisfactory result and achieve better real-time performance. Real-time seam update is performed to reduce the deformation effect caused by moving objects. Video fusion is achieved using multi-resolution spline algorithm. By means of look-up table, the process of video alignment, registration and matching is simplified. It is verified by the experiments that the proposed method can achieve satisfactory real-time stitching result.